-- Logs begin at Thu 2021-11-11 10:40:56 UTC, end at Thu 2021-11-11 12:08:29 UTC. -- Nov 11 11:31:21.530306 dv-cinder-817417-1-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 11 11:31:24.274643 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.common.config [-] Logging enabled! Nov 11 11:31:24.275299 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 16.4.2.dev54 Nov 11 11:31:24.276648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=88215) setup_logging /opt/stack/neutron/neutron/common/config.py:111}} Nov 11 11:31:24.277416 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.common.config [-] Logging enabled! Nov 11 11:31:24.277711 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 16.4.2.dev54 Nov 11 11:31:24.277995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=88215) setup_logging /opt/stack/neutron/neutron/common/config.py:111}} Nov 11 11:31:24.279125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Nov 11 11:31:24.279443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Nov 11 11:31:24.280644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Nov 11 11:31:24.280936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Nov 11 11:31:24.281199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Nov 11 11:31:24.281584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.281938 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.282279 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.282543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.282889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.283262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.283589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.283991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.284341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.284666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.284982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.285309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.285575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.285893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] config_source = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.286225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.286556 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.286813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] debug = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.287136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.287717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.288579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.288901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.289235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.289543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.289880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.290206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.290599 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] host = dv-cinder-817417-1-iscsi {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.290916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.291277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.291614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.291936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.292251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.292563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.292889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.293198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] log_dir = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.293506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] log_file = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.293822 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.294154 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.294483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.294825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.295085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.295372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.295704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.296035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.296352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.296667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.296970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.297283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.297589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.297894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.298234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.298565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.298892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.299237 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.299551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.299854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.300162 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.300489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.300799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.301108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.301417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.301760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.302055 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.302362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.302722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.303127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.304055 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.304392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.304704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.305038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.305349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.305660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] use_journal = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.305968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] use_json = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.306277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.306585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.306912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.307250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.307567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.307875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.308183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.308514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:24.308855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.309201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.309548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.309869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.310201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.310523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.310854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.311195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.311533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.311871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.312197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.312512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.312836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.313179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.313519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.313830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.314153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.314489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.314806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.315113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.315480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.315798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.316109 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.316429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.316747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.317053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.317360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.317680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.318014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.318348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.318635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.318942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.319320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.319633 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.319959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.320275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.320585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.320893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.321208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.321516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.321824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.322138 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.322446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.322758 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.323066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.323437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.323746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.324058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.324365 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.324680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.324985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.325298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.325607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.325915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.326228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.326539 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.326858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.327210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.327550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.327868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.328184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.328497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.328810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.329122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.329510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.329831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.330140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.330450 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.330795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.331121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.331827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.332153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.332470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.332810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.333127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.333449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.333764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.334086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.334407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.334772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.335106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.335480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.335859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.336191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.336529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.336848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.337213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.337536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:24.337785 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Nov 11 11:31:24.338079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=88215) load_app /usr/local/lib/python3.6/dist-packages/oslo_service/wsgi.py:352}} Nov 11 11:31:25.021039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=88215) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:31:25.021357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=88215) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:31:25.021688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=88215) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:31:25.024044 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 11 11:31:25.388190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.388723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.388723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.453176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.453496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.453801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.457316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.457627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.457928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.612721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.613036 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.613337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.614371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.614673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.614968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.750871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.751209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.751527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.751831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.752736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.949282 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.949674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.950004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.950312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.950616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.951003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.951332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.951633 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.951928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.952275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.952576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.952886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.953199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.953497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.953818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.954142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.954438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.954781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.955065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.955448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.955929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.956218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.956506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.957124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.957408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.957688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:25.958189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=88215) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 11:31:25.958468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=88215) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 11:31:25.958747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=88215) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 11:31:25.959023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=88215) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 11:31:25.959326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=88215) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 11:31:25.960233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=88215) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 11:31:25.961664 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 11 11:31:25.970353 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 11 11:31:25.978665 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 11 11:31:25.984582 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(1000, 1049)])]) Nov 11 11:31:25.987618 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 11 11:31:25.988867 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 11 11:31:25.989265 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 11 11:31:25.989714 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 11 11:31:25.994274 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 11 11:31:25.994553 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 11 11:31:25.994956 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 11 11:31:26.024432 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic'] Nov 11 11:31:26.024895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.025239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=88215) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 11 11:31:26.025657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.027123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=88215) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 11 11:31:26.027485 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 11 11:31:26.027773 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 11 11:31:26.031354 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.031684 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.099052 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 11 11:31:26.099351 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 11 11:31:26.099587 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 11 11:31:26.100017 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 11 11:31:26.136289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.sqlalchemy.engines [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=88215) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 11 11:31:26.548167 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Initializing driver for type 'gre' Nov 11 11:31:26.549055 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] gre ID ranges: [(1, 1000)] Nov 11 11:31:26.668565 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Initializing driver for type 'local' Nov 11 11:31:26.668942 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Initializing driver for type 'vlan' Nov 11 11:31:26.743947 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] VlanTypeDriver initialization complete Nov 11 11:31:26.744332 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Initializing driver for type 'vxlan' Nov 11 11:31:26.744901 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] vxlan ID ranges: [(1, 1000)] Nov 11 11:31:26.868571 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Initializing extension driver 'port_security' Nov 11 11:31:26.868952 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.extensions.port_security [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] PortSecurityExtensionDriver initialization complete Nov 11 11:31:26.869413 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Initializing mechanism driver 'openvswitch' Nov 11 11:31:26.869836 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Initializing mechanism driver 'hyperv' Nov 11 11:31:26.876801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=88215) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:31:26.877726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > port after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.878189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > port after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.878625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > port after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.879123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > subnet after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.879650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > subnet after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.880100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > subnet after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.880583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > network after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.881025 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > network after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.881458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > network after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.881934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > security_group after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.882372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > security_group after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.882805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > security_group after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.883313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.883759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.884458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.884882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] ML2 OVO RPC backend initialized. {{(pid=88215) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:140}} Nov 11 11:31:26.885745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router_interface after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.886251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.886816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > network before_response 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.887364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > networks before_response 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.887855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > port before_response 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.888335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > ports before_response 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.888821 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > subnet before_response 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.889303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > subnets before_response 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.889917 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > network after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.890391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > network after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.890869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > network after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.891395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > port after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.891877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > port after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.892355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > port after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.892831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > subnet after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.893314 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > subnet after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.893787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > subnet after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.894600 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.plugin [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Modular L2 Plugin initialization complete Nov 11 11:31:26.895099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading services supported by the core plugin {{(pid=88215) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:171}} Nov 11 11:31:26.895622 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.plugins.ml2.managers [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Got port-security extension from driver 'port_security' Nov 11 11:31:26.896251 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.extensions.vlantransparent [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Disabled vlantransparent extension. Nov 11 11:31:26.896811 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=88215) _load_service_plugins /opt/stack/neutron/neutron/manager.py:197}} Nov 11 11:31:26.897761 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading Plugin: router Nov 11 11:31:26.945005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router_interface before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.945452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router after_create 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.945866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router before_create 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.946274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.946702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.947100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router after_delete 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.947581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > floatingip after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.948001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router after_create 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.948392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router after_update 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.948788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router after_update 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.949188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.949595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router after_update 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.950121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_update 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.950560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: port after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.950948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: port after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.951364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: subnet after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.951764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.952157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > port precommit_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.952549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_create 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.952940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: port before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.953328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.953744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router after_update 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.954131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_delete 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.954529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_create 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.954944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router_interface after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.955367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_update 55549900 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.955801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > agent after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.956201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > agent after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.956851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > network after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.957965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Tracking information for resource: router configured {{(pid=88215) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 11:31:26.958345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Tracking information for resource: floatingip configured {{(pid=88215) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 11:31:26.964401 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_agentschedulers_db [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 11 11:31:26.965068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: port after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.965482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: port after_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.965885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: port after_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.966276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: port after_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.967279 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router before_create 55550100 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.967696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_delete 55550100 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.968107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_create 55550100 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.968508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > router precommit_update 55550100 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:26.973433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.provider_configuration [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service providers = [] {{(pid=88215) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 11 11:31:26.973832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.servicetype_db [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=88215) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 11 11:31:26.977497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.service_base [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=88215) load_drivers /opt/stack/neutron/neutron/services/service_base.py:52}} Nov 11 11:31:26.977889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.service_base [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=88215) load_drivers /opt/stack/neutron/neutron/services/service_base.py:52}} Nov 11 11:31:26.978273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.service_base [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=88215) load_drivers /opt/stack/neutron/neutron/services/service_base.py:52}} Nov 11 11:31:26.979221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.service_base [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=88215) load_drivers /opt/stack/neutron/neutron/services/service_base.py:52}} Nov 11 11:31:26.979641 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.services.service_base [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 11 11:31:26.980083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=88215) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:235}} Nov 11 11:31:26.980452 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 11 11:31:27.003132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=88215) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:235}} Nov 11 11:31:27.003534 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading Plugin: auto_allocate Nov 11 11:31:27.015316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: network precommit_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:27.015725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: network precommit_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:27.016356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=88215) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:235}} Nov 11 11:31:27.016722 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading Plugin: tag Nov 11 11:31:27.029845 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=88215) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:235}} Nov 11 11:31:27.030216 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading Plugin: timestamp Nov 11 11:31:27.034429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=88215) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:235}} Nov 11 11:31:27.034801 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading Plugin: network_ip_availability Nov 11 11:31:27.041644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:27.042060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:27.042459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:27.043381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=88215) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:235}} Nov 11 11:31:27.043754 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading Plugin: flavors Nov 11 11:31:27.061207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=88215) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:235}} Nov 11 11:31:27.061578 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading Plugin: revisions Nov 11 11:31:27.066491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=88215) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:235}} Nov 11 11:31:27.066927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.045s {{(pid=88215) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:31:27.067808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=88215) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:638}} Nov 11 11:31:27.068177 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Initializing extension manager. Nov 11 11:31:27.068766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: __init__.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.069217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: __pycache__ {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.069699 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: _admin_state_down_before_update_lib.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.070176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: _availability_zone_filter_lib.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.070660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: _filter_validation_lib.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.071138 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.071656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: address_scope.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.072687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.073477 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: address-scope Nov 11 11:31:27.073935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: admin_state_down_before_update.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.075095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is down (admin_state_up=False) before updating the distributed attribute" updated="2019-04-08 13:30:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.075885 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: router-admin-state-down-before-update Nov 11 11:31:27.076345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: agent.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.077293 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.077992 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: agent Nov 11 11:31:27.078460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: agent_resources_synced.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.079623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.080316 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: agent-resources-synced Nov 11 11:31:27.080783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: allowedaddresspairs.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.083111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.083779 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: allowed-address-pairs Nov 11 11:31:27.084150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: auto_allocated_topology.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.085915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.086503 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: auto-allocated-topology Nov 11 11:31:27.086875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: availability_zone.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.087896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.088491 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: availability_zone Nov 11 11:31:27.088864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: availability_zone_filter.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.089887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.090472 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: availability_zone_filter Nov 11 11:31:27.090843 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: data_plane_status.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.091852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.092439 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension data-plane-status not supported by any of loaded plugins Nov 11 11:31:27.092804 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: default_subnetpools.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.093767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.094346 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: default-subnetpools Nov 11 11:31:27.094712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: dhcpagentscheduler.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.095701 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.096298 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: dhcp_agent_scheduler Nov 11 11:31:27.096665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: dns.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.097658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.098246 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension dns-integration not supported by any of loaded plugins Nov 11 11:31:27.098613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: dns_domain_ports.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.099636 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.100276 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 11 11:31:27.101154 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: dvr.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.101952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.102531 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: dvr Nov 11 11:31:27.102893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: empty_string_filtering.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.103934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.104508 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: empty-string-filtering Nov 11 11:31:27.104870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.105815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.106386 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 11 11:31:27.106749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.107742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.108319 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 11 11:31:27.108684 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: external_net.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.109641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.110216 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: external-net Nov 11 11:31:27.110579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: extra_dhcp_opt.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.111577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.112152 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: extra_dhcp_opt Nov 11 11:31:27.112519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: extraroute.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.113462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.114043 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: extraroute Nov 11 11:31:27.114407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: extraroute_atomic.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.115646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.116268 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: extraroute-atomic Nov 11 11:31:27.116634 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: filter_validation.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.117373 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-03-21T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.117949 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: filter-validation Nov 11 11:31:27.118314 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: fip_pf_description.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.119366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.119897 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 11 11:31:27.120259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: fip_port_details.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.121249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.121829 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: fip-port-details Nov 11 11:31:27.122195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: flavors.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.123538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.124124 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: flavors Nov 11 11:31:27.124495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.126315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.126914 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 11 11:31:27.127353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: floatingip_pools.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.128176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.128772 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: floatingip-pools Nov 11 11:31:27.129140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: ip_allocation.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.130147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.130731 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension ip_allocation not supported by any of loaded plugins Nov 11 11:31:27.131104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.132167 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.132749 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: ip-substring-filtering Nov 11 11:31:27.133119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: l2_adjacency.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.134095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.134669 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 11 11:31:27.135032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: l3.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.136262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.136859 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: router Nov 11 11:31:27.137228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: l3_conntrack_helper.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.140042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.140659 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 11 11:31:27.141043 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.142047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.142638 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: ext-gw-mode Nov 11 11:31:27.143014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.144008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.144799 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: l3-ha Nov 11 11:31:27.145168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: l3_flavors.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.146228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.146817 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: l3-flavors Nov 11 11:31:27.147756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.148838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.149533 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 11 11:31:27.149900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: l3agentscheduler.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.151975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.152829 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: l3_agent_scheduler Nov 11 11:31:27.153461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: logging.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.155842 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.156706 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension logging not supported by any of loaded plugins Nov 11 11:31:27.157329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: metering.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.160413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.161157 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: metering Nov 11 11:31:27.161547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: multiprovidernet.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.162709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.163887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: multi-provider Nov 11 11:31:27.164283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: netmtu.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.165284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.165882 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: net-mtu Nov 11 11:31:27.166252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: netmtu_writable.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.167525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.168309 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: net-mtu-writable Nov 11 11:31:27.168679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: network_availability_zone.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.169520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.170106 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: network_availability_zone Nov 11 11:31:27.170471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: network_ip_availability.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.171825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.172413 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: network-ip-availability Nov 11 11:31:27.172782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: network_segment_range.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.173744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.174333 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension network-segment-range not supported by any of loaded plugins Nov 11 11:31:27.174702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: pagination.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.175817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.176194 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: pagination Nov 11 11:31:27.176563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.177547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.178120 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: port-mac-address-regenerate Nov 11 11:31:27.178517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: port_resource_request.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.179520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.180107 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension port-resource-request not supported by any of loaded plugins Nov 11 11:31:27.180474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: portbindings.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.181443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.182027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: binding Nov 11 11:31:27.182394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: portbindings_extended.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.183788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.184366 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: binding-extended Nov 11 11:31:27.184731 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: portsecurity.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.185682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.186273 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: port-security Nov 11 11:31:27.186646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: project_id.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.187706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.188087 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: project-id Nov 11 11:31:27.188449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: providernet.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.189539 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.190134 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: provider Nov 11 11:31:27.190503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.194397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.195015 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos not supported by any of loaded plugins Nov 11 11:31:27.195452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.196772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.197355 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 11 11:31:27.197723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.198676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.199295 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 11 11:31:27.199667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos_default.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.200620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.201200 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos-default not supported by any of loaded plugins Nov 11 11:31:27.201575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos_fip.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.202292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.202865 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos-fip not supported by any of loaded plugins Nov 11 11:31:27.203259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos_gateway_ip.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.204224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.204797 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 11 11:31:27.205167 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos_port_network_policy.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.206112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.206952 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 11 11:31:27.207362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos_rule_type_details.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.208333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.208906 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 11 11:31:27.209284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: qos_rules_alias.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.210915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.211558 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 11 11:31:27.211906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: quotasv2.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.213083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.213467 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: quotas Nov 11 11:31:27.213835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: quotasv2_detail.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.215556 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.215939 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: quota_details Nov 11 11:31:27.216308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: rbac.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.217549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.218186 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: rbac-policies Nov 11 11:31:27.218560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: rbac_address_scope.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.219606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.220203 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: rbac-address-scope Nov 11 11:31:27.220571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: rbac_security_groups.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.221533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.222130 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: rbac-security-groups Nov 11 11:31:27.222496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: rbac_subnetpool.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.223504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.224100 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: rbac-subnetpool Nov 11 11:31:27.224470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: revisionifmatch.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.225997 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.226586 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: revision-if-match Nov 11 11:31:27.226954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: revisions.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.228160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.228746 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: standard-attr-revisions Nov 11 11:31:27.229113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: router_availability_zone.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.229899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.230491 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: router_availability_zone Nov 11 11:31:27.230857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: routerservicetype.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.231854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.232442 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension router-service-type not supported by any of loaded plugins Nov 11 11:31:27.232808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: security_groups_port_filtering.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.233781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.234370 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: port-security-groups-filtering Nov 11 11:31:27.234738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: securitygroup.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.248258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.248930 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: security-group Nov 11 11:31:27.249309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: segment.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.250311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.250911 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension segment not supported by any of loaded plugins Nov 11 11:31:27.251318 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.252395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.252987 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 11 11:31:27.253356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: servicetype.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.254552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.255258 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: service-type Nov 11 11:31:27.255630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: sorting.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.257381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.257772 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: sorting Nov 11 11:31:27.258135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: standard_attr_segment.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.259102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.259738 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 11 11:31:27.260100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: standardattrdescription.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.260876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.261457 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: standard-attr-description Nov 11 11:31:27.261830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: stateful_security_group.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.262845 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.263466 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: stateful-security-group Nov 11 11:31:27.263831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: stdattrs_common.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.264440 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 11 11:31:27.264803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.265756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.266341 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 11 11:31:27.266704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: subnet_onboard.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.267869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.268458 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: subnet_onboard Nov 11 11:31:27.268822 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.269791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.270385 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 11 11:31:27.270746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: subnet_service_types.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.271811 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.272963 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: subnet-service-types Nov 11 11:31:27.273325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: subnetallocation.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.274463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.275036 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: subnet_allocation Nov 11 11:31:27.275431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.276173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.276762 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: subnetpool-prefix-ops Nov 11 11:31:27.277128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.278123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.278700 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 11 11:31:27.279062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: tagging.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.280888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, router, floatingip, policy, security_group, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.281499 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: standard-attr-tag Nov 11 11:31:27.281867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: timestamp.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.283212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.283868 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loaded extension: standard-attr-timestamp Nov 11 11:31:27.284280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: trunk.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.285545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.286187 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension trunk not supported by any of loaded plugins Nov 11 11:31:27.286598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: trunk_details.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.287773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.288429 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension trunk-details not supported by any of loaded plugins Nov 11 11:31:27.288838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: uplink_status_propagation.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.289865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.290503 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 11 11:31:27.290912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Loading extension file: vlantransparent.py {{(pid=88215) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:448}} Nov 11 11:31:27.291748 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=88215) _check_extension /opt/stack/neutron/neutron/api/extensions.py:419}} Nov 11 11:31:27.292383 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 11 11:31:27.295001 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:network Nov 11 11:31:27.295928 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:subnet Nov 11 11:31:27.296606 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 11:31:27.297281 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:port Nov 11 11:31:27.298756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.299284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service FLAVORS assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.300005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.300488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.300872 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:router Nov 11 11:31:27.301625 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:floatingip Nov 11 11:31:27.302422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service METERING assigned prefix: /metering {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.304424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:27.304827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:27.305222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88215) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:31:27.306477 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of CountableResource for resource:rbac_policy Nov 11 11:31:27.306989 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:security_group Nov 11 11:31:27.307884 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 11 11:31:27.308727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service CORE assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.309106 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 11:31:27.309480 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] subnetpool is already registered Nov 11 11:31:27.310168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service CORE assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.310541 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 11:31:27.310917 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] subnetpool is already registered Nov 11 11:31:27.313752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.314239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service FLAVORS assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.314891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.315398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.315784 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:router Nov 11 11:31:27.316162 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] router is already registered Nov 11 11:31:27.316870 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:floatingip Nov 11 11:31:27.317331 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] floatingip is already registered Nov 11 11:31:27.318048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service METERING assigned prefix: /metering {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.318825 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of CountableResource for resource:rbac_policy Nov 11 11:31:27.319769 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] rbac_policy is already registered Nov 11 11:31:27.320237 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:security_group Nov 11 11:31:27.320602 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] security_group is already registered Nov 11 11:31:27.321462 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 11 11:31:27.321828 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] security_group_rule is already registered Nov 11 11:31:27.322587 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service CORE assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.322969 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 11:31:27.323371 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] subnetpool is already registered Nov 11 11:31:27.324078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.resource_helper [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Service CORE assigned prefix: {{(pid=88215) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Nov 11 11:31:27.324451 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 11:31:27.324820 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.quota.resource_registry [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] subnetpool is already registered Nov 11 11:31:27.325551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: extensions {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.327185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: address-scopes {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.328436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: agents {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.329783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: auto-allocated-topology {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.331105 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: availability_zones {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.332735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: dhcp-networks {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.334315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: dhcp-agents {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.336387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: routers {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.338141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: flavors {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.340595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: service_profiles {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.341858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: next_providers {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.343393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: service_profiles {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.344882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: floatingip-pools {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.346255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: routers {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.348037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: floatingips {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.349279 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: l3-routers {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.350868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: l3-agents {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.352390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: metering-labels {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.353688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: metering-label-rules {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.355114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: network-ip-availabilities {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.356439 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: bindings {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.358069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: quotas {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.359692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: quotas {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.361176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: rbac-policies {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.362437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: security-groups {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.363722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: security-group-rules {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.365120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: service-providers {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.366452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: subnetpools {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.367862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: subnetpools {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.369515 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.371247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.373089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.375016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.376789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.378633 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.380535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.382887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.384960 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.386901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.extensions [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Extended resource: tags {{(pid=88215) __init__ /opt/stack/neutron/neutron/api/extensions.py:155}} Nov 11 11:31:27.394138 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING keystonemiddleware.auth_token [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 11:31:27.400030 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING keystonemiddleware.auth_token [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 11:31:27.409268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Acquired lock "singleton_lock" {{(pid=88215) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:265}} Nov 11 11:31:27.409806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Releasing lock "singleton_lock" {{(pid=88215) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:281}} Nov 11 11:31:27.411324 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO oslo_service.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Starting 2 workers Nov 11 11:31:27.416294 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Started child 88328 {{(pid=88215) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:579}} Nov 11 11:31:27.421335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Started child 88329 {{(pid=88215) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:579}} Nov 11 11:31:27.422184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:27.423058 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 11 11:31:27.423815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Notify callbacks [] for process, before_spawn {{(pid=88215) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:27.424505 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [-] (88328) wsgi starting up on http://0.0.0.0:9696 Nov 11 11:31:27.426491 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO oslo_service.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Starting 1 workers Nov 11 11:31:27.426857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:27.428536 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [-] (88329) wsgi starting up on http://0.0.0.0:9696 Nov 11 11:31:27.432297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Started child 88330 {{(pid=88215) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:579}} Nov 11 11:31:27.432964 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO oslo_service.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Starting 1 workers Nov 11 11:31:27.437774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] calling RpcWorker wait() {{(pid=88330) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 11 11:31:27.438068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Started child 88331 {{(pid=88215) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:579}} Nov 11 11:31:27.438466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.service [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] returning from RpcWorker wait() {{(pid=88330) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 11 11:31:27.438704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfdb67c5-4c3c-4b42-aef4-50ac2ebf60e0 None None] Notify callbacks [] for process, after_spawn {{(pid=88215) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:27.440864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=88215) wait /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:653}} Nov 11 11:31:27.441115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:27.441244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Nov 11 11:31:27.441244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Nov 11 11:31:27.441526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Nov 11 11:31:27.441653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:31:27.442229 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Nov 11 11:31:27.442408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Nov 11 11:31:27.443177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.443486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.443711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:27.443864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.444617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.444951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.445674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.445920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:31:27.446071 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.446305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.446544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.447006 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.447283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.447422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.447674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.448141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.448499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.448806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.449052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.449481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.449892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.450185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] config_source = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.450531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.450781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.451281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] debug = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.451580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.452202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.452441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.452911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.453188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.453495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.453785 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.454064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.454532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.454765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.455052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.455335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.455581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.455810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.456195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.456422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.457041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] host = dv-cinder-817417-1-iscsi {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.457308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.457627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.457862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.458099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.458317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.458532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.458897 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.459113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.459427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.460288 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.460513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.460774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.461059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_dir = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.461410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_file = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.461635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_options = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.461836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.462041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.462267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.462607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.462607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.463041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.463041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.463533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.463533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.463944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.464175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.464395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.464612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.464819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.465032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.465241 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.465538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.465747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.465952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.466177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.466573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.466782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.467004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.467262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.467477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.467685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.467896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.468120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.468340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.468562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.468871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.469252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.469469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.469709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.469920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.470164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.470382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.470677 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.470947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.471244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.471496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.471855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.472080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.472297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.472506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_journal = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.472893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_json = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.472893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.473330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.473544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.473755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.473973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.474189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.474388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.474578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.474999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.475404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.475765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.476056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.476332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.476687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.476880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.477120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.477409 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.477700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.478024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.478316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.478671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.478972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.479349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.11/identity {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.479544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.479793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.480071 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.480342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.480595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.480868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.481119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.481424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.481681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.482016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.482202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.482442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.482745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.483082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.483329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.483598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.483947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.484158 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.484348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.484585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.484837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.485121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.485390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.485692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.485989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.486267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.486518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.486865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.487076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.487337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.487531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.487726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.487931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.488221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.488457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.488718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.488977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.490322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.490814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.491303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.491755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.492225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.492999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.493111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.493588 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.494327 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.494792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.497591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.497591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.497591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.497591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.497591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.497591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.498613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.498613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.498613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.499049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.499477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.500696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.501276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.501817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.502313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.502750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.503247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.503979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.504461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.504907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.506302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.507316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.507865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.508340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.508931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.509306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.509770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.510286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.510742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.511251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.511690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.512157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.512614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.513126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.513620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.514122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.514601 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.515727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.515727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.516122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.517677 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.517677 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.517677 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.518445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.518658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.519217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.519716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.520218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.521149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.521149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.521631 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.522709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.523252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.523692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.524213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.524809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.525314 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.525753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.526150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.526852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.527625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.528231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.528996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.529490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.529989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.530489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.530958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.11/identity {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.531464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.531927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.532483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.532900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.533505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.534189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.534879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.535611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.536291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.537026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.537752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.538437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.539134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.539901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.540562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.541319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.541992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.542704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.543531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.544219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.544904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.545596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.546297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.547049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.547789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.548560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.549781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.550481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.550986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.551563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.552068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.552512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.553013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.553500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.553942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.554382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.554855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.555351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.555779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.556533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.557274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.557825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.558574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.559467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.559926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.560391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.561050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.561690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.562383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.562836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.563311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.564028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.564792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.565392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.565948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.566507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.566996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.567726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.568467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.569711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.570415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.571140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.571902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.572575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.573200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.573877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] xenapi.connection_password = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.574648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] xenapi.connection_url = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.575312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] xenapi.connection_username = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.576044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.576740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.577395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.578089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.578743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.580504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.581169 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.582111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.582840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.583616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.584364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.585623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.587123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.587637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.588126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.588659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.589238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.589640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.590176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.590800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.591262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1000:1049'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.591636 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.592046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.592564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_blacklist = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.593089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.593523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.593914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.594290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.594691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.595056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.595503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.595857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.596209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.596572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.596973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.597432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.597875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.598284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.598674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.599051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.599516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.599866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.600257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.600616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.600877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Nov 11 11:31:27.601616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=88215) wait /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:653}} Nov 11 11:31:27.601877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Nov 11 11:31:27.602127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Nov 11 11:31:27.602430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Nov 11 11:31:27.602709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Nov 11 11:31:27.602957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Nov 11 11:31:27.603337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.603600 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.603860 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.604116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.604377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.604667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.604925 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.605182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.605439 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.605694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.606070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.606327 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.606584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.606843 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.607099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.607391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.607655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.607955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.608265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.608554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] config_source = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.608861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.609102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.609390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] debug = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.609635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.609911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.610148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.610387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.610626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.610880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.611204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.611497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.611721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.611993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.612288 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.612580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.612807 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.613089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.613361 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.613611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.613854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] host = dv-cinder-817417-1-iscsi {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.614097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.614339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.614568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.614825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.615058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.615335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.615580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.616360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.616609 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.616914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.617192 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.617475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.617722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_dir = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.618151 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_file = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.618382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_options = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.618600 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.618817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.619082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.619387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.619712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.619948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.620251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.620572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.620884 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.621205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.621490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.621767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.622044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.622280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.622524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.622783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.623090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.623460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.623734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.623978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.624221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.624460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.624710 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.625016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.625315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.625616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.625922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.626204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.626786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.627101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.627422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.627669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.627916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.628338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.628571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.628788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.628964 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.629292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.629572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.631203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.631203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.631203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.631203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.631203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.631203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_journal = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.631203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_json = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.631203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.632550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.632550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.632550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.632550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.632550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.632989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.632989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Nov 11 11:31:27.633141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:31:27.633214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.633214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.633340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.633640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.633769 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.633869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.634026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.634218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.634408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.634598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.634799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.634994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.635203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.635358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.635554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.11/identity {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.635743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.635933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.636122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.636313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.636502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.636694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.636887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.637074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.637263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.637450 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.637636 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.637825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.638019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.638202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.638508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.638626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.638791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.638981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.639189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.639392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.639581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.639770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.639958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.640146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.640350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.640646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.640764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.640863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.641039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.641251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.641437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.641627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.641805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.641968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.642143 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.642304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.642448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.642651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.642833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.643028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.643239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.643436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.643623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.643825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.643974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.644164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.644352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.644540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.644727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.644915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.645103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.645291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.645477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.645675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.645839 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.646024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.646187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.646348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.646518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.646676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.646835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.647029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.647229 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.647395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.647556 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.647719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.647881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.648040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.648200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.648363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.648624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.648763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.648924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.649083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.649240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.649399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.649558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.649723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.649882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.650057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.650224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.650387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.650549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.650709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.650844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.651004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.651508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.651508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.651508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.651979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.651979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.651979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.652406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.652406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.655755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.657173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.657173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.657173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.657173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.657173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.657173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.657173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.657173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.658337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.658337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.658337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.11/identity {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.658337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.658337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.658337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.658337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.658337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.662404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.662404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.662404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.662404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.662404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.662404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.662404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.662404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.663608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.663608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.663608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.663608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.663608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.663608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.663608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.663608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.664778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.664778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.664778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.664778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.664778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.664778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.664778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.664778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.666035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.666035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.666035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.666035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.666035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.666035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.666035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.666035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.667243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.667243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.667243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.667243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.667243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.667243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.667243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.667243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.668406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.668406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.668406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.668406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.668406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.668406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.668406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.668406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.669577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.670891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.670891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.670891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.670891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] xenapi.connection_password = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.670891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] xenapi.connection_url = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.670891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] xenapi.connection_username = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.670891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.670891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.673664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.673664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.673664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.673664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.673664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.673664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.673664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.673664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.675104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.675104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.675104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.675104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.675104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.675104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.675104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.675104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.676292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.676292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.676292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1000:1049'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.676292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.676292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.676292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_blacklist = [] {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.676292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.676292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.677429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.679367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Nov 11 11:31:27.682461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=88215) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Nov 11 11:31:27.749108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56488) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:31:27.763417 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [-] 10.222.0.11 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0117543 Nov 11 11:31:40.112874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5958d28d-cc0a-4c46-b896-e0de1c31e505 None None] get_active_networks_info from dv-cinder-817417-1-iscsi {{(pid=88330) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 11 11:31:40.774322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5958d28d-cc0a-4c46-b896-e0de1c31e505 None None] No non-hosted networks {{(pid=88330) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 11 11:31:40.952037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ba8073f-7d1c-4154-9ba0-127d983329b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports--9223372036850728341'] for agent, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:41.320729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports--9223372036850728341'] for agent, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:41.321551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.321745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.321937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.327189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.327189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.327189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.327189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.327189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.332729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.332729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.332729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:41.332729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-817417-1-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.5', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0'}) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:31:41.333394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-817417-1-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.5', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0'}} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:31:43.469737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d8c08d9e-535a-42bc-ad45-0a219ad1c832 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports--9223372036850728341'] for agent, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:43.531191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports--9223372036850728341'] for agent, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:43.576628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-910092c1-8420-4577-a88b-e5795e8dc841 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:44.599281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports--9223372036850728341'] for agent, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:46.218586 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_hamode_db [None req-928d675e-7d7c-4fa7-92e9-dfa4c640394f None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 11 11:31:46.265615 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56602) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:31:46.313304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-928d675e-7d7c-4fa7-92e9-dfa4c640394f None None] Routers set() bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:31:46.313725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-928d675e-7d7c-4fa7-92e9-dfa4c640394f None None] Router IDs set() for agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}} Nov 11 11:31:47.088965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [None req-a5612839-8b63-49b7-8216-54c52540ed98 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:31:47.090293 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a5612839-8b63-49b7-8216-54c52540ed98 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.8236165 Nov 11 11:31:49.431656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56618) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:31:49.544049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-1679a15d-7a48-4063-8a5d-a3f4ddb620ac admin admin] Request body: {'subnetpool': {'shared': True, 'is_default': True, 'default_prefixlen': 26, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:31:49.797135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.policy [None req-1679a15d-7a48-4063-8a5d-a3f4ddb620ac admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=88329) register_rules /opt/stack/neutron/neutron/policy.py:68}} Nov 11 11:31:49.805071 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota [None req-1679a15d-7a48-4063-8a5d-a3f4ddb620ac admin admin] Loaded quota_driver: . Nov 11 11:31:49.842185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1679a15d-7a48-4063-8a5d-a3f4ddb620ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:31:49.942367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1679a15d-7a48-4063-8a5d-a3f4ddb620ac admin admin] Notify callbacks ['neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731490119761', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731490067622', 'neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731490066475', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731489232732', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731489232617', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create--9223372036853572815', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1293881', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change--9223372036850985191', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change--9223372036850632378'] for rbac-policy, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:50.233622 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1679a15d-7a48-4063-8a5d-a3f4ddb620ac admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:50.235351 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1679a15d-7a48-4063-8a5d-a3f4ddb620ac admin admin] 10.222.0.11 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8023057 Nov 11 11:31:52.650076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56634) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:31:52.738288 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Request body: {'network': {'project_id': '18d3a6e71770432ab5b33a5491589191', 'admin_state_up': True, 'name': 'private'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:31:52.744644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:31:52.752367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Usage tracker for resource:network and tenant:18d3a6e71770432ab5b33a5491589191 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:31:52.756895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:31:52.764250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:31:52.810709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Made reservation on behalf of 18d3a6e71770432ab5b33a5491589191 for: {'network': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:31:52.817110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:52.837372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:52.957552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:31:52.962604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Usage tracker for resource:security_group_rule and tenant:18d3a6e71770432ab5b33a5491589191 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:31:52.966066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:31:52.973299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:31:53.132668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:53.176940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:53.183066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:31:53.202660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1002} {{(pid=88329) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:31:53.232560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363305364150081', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:53.233106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Unsubscribe: segment precommit_create {{(pid=88329) unsubscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:84}} Nov 11 11:31:53.233574 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Added segment a995df8c-9ef1-493f-ab17-b148440b895d of type vlan for network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 Nov 11 11:31:53.293345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8a1ea72-9094-4ddc-920e-7f7722c515f8,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:31:53.320719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.321091 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.321464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.321824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.322195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.322553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.322908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.323296 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.323651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.323998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.324348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Tracked resource versions report: Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: pushed versions: Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: { 'ConntrackHelper': {'1.0'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': {'1.0'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': {'1.1'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': {'1.5'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': {'1.2'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': {'1.8'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': {'1.2'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': {'1.0'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': {'1.0'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': {'1.1'}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': {'1.1'}} Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: consumer versions: Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: { DHCP agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: L3 agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: Metadata agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: Metering agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: Open vSwitch agent@dv-cinder-817417-1-iscsi: { 'ConntrackHelper': '1.0', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': '1.0', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': '1.1', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': '1.5', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': '1.2', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': '1.8', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': '1.2', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': '1.0', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': '1.0', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': '1.1', Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': '1.1'}} Nov 11 11:31:53.325528 dv-cinder-817417-1-iscsi neutron-server[88215]: {{(pid=88329) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Nov 11 11:31:53.361962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:53.384293 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:31:53.445331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:53.447041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:31:53.447799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:53.454815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:31:53.612874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Pushing event updated for resources: {'Network': ['ID=ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:31:53.616983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:31:53.626659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:31:53.743189 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 850 time: 1.0811870 Nov 11 11:31:56.136938 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56652) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:31:56.328702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2585cb05-655e-4964-b9ee-4534ec2b2405 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:31:56.330177 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2585cb05-655e-4964-b9ee-4534ec2b2405 admin admin] 10.222.0.11 "GET /v2.0/networks/ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 HTTP/1.1" status: 200 len: 826 time: 0.1921959 Nov 11 11:31:56.361083 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d018d496-2ad7-4fb0-8f4e-49e51ba1e994 admin admin] 10.222.0.11 "GET /v2.0/subnetpools/245a89ea-be0e-48e1-8f16-37292282e7ff HTTP/1.1" status: 200 len: 734 time: 0.0243392 Nov 11 11:31:56.371957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Request body: {'subnet': {'subnetpool_id': '245a89ea-be0e-48e1-8f16-37292282e7ff', 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'tenant_id': '18d3a6e71770432ab5b33a5491589191'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:31:56.377020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:31:56.381756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Usage tracker for resource:subnet and tenant:18d3a6e71770432ab5b33a5491589191 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:31:56.384943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:31:56.390976 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:31:56.507748 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Made reservation on behalf of 18d3a6e71770432ab5b33a5491589191 for: {'subnet': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:31:56.512770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:57.085692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:57.091284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:31:57.184856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=581b2ab6-6bb0-4e99-b28d-d754f1bd327b,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:31:57.189765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Checking segment: {'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:31:57.190153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Network hostable DHCP agents. Network: ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88329) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:31:57.195057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:31:57.256823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88329) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:31:57.313723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7) {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:31:57.319900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:31:57.320850 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:57.325941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0d9c259-3537-4d16-b62b-7b2139d44d08 None None] Network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:31:57.377517 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 1.0092945 Nov 11 11:31:57.800527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'fixed_ips': [{'subnet_id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:31:57.802115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:58.124189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Allocated IP 172.20.0.2 (ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7/581b2ab6-6bb0-4e99-b28d-d754f1bd327b/a7cb53e5-8632-4771-af30-0f2b4b488164) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:31:58.400355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:58.488583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Transition to ACTIVE for port object a7cb53e5-8632-4771-af30-0f2b4b488164 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:31:58.516495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Transition to ACTIVE for port object a7cb53e5-8632-4771-af30-0f2b4b488164 will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:31:58.554293 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:58.560604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:31:58.632348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:31:58.640941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:31:58.651379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:31:58.653961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Pushing event updated for resources: {'Port': ['ID=a7cb53e5-8632-4771-af30-0f2b4b488164,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:31:58.696573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.696952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.697319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.697679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.698039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.698394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.698746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.699132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.699527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.699875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.700230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Tracked resource versions report: Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: pushed versions: Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: { 'ConntrackHelper': {'1.0'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': {'1.0'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': {'1.1'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': {'1.5'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': {'1.2'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': {'1.8'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': {'1.2'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': {'1.0'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': {'1.0'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': {'1.1'}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': {'1.1'}} Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: consumer versions: Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: { DHCP agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: L3 agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: Metadata agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: Metering agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: Open vSwitch agent@dv-cinder-817417-1-iscsi: { 'ConntrackHelper': '1.0', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': '1.0', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': '1.1', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': '1.5', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': '1.2', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': '1.8', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': '1.2', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': '1.0', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': '1.0', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': '1.1', Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': '1.1'}} Nov 11 11:31:58.701372 dv-cinder-817417-1-iscsi neutron-server[88215]: {{(pid=88330) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Nov 11 11:31:58.715338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:31:58.775707 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Attempting to bind port a7cb53e5-8632-4771-af30-0f2b4b488164 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:31:58.776131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Attempting to bind port a7cb53e5-8632-4771-af30-0f2b4b488164 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:31:58.776568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Attempting to bind port a7cb53e5-8632-4771-af30-0f2b4b488164 on network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:31:58.784867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 31, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:31:58.785304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Checking segment: {'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:31:58.785748 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:58.786388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Bound using segment: {'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:31:58.787066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Bound port: a7cb53e5-8632-4771-af30-0f2b4b488164, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:31:58.787503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:58.890221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] For port a7cb53e5-8632-4771-af30-0f2b4b488164, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:31:58.895003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] For port a7cb53e5-8632-4771-af30-0f2b4b488164, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=a7cb53e5-8632-4771-af30-0f2b4b488164,segment=NetworkSegment(a995df8c-9ef1-493f-ab17-b148440b895d),segment_id=a995df8c-9ef1-493f-ab17-b148440b895d)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:31:58.925665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:31:58.930452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:31:59.027970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Pushing event updated for resources: {'Port': ['ID=a7cb53e5-8632-4771-af30-0f2b4b488164,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:31:59.031520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:31:59.701902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56664) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:31:59.786937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [None req-3ef707ed-f97d-4718-a295-1c8c002fe814 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:31:59.788147 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3ef707ed-f97d-4718-a295-1c8c002fe814 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.0851090 Nov 11 11:32:02.096435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 56676) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:32:02.658177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [None req-bf7f1d69-219b-4562-ae41-30e1db45ca0a admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88328) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:32:02.659518 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-bf7f1d69-219b-4562-ae41-30e1db45ca0a admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.5609219 Nov 11 11:32:03.649474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device a7cb53e5-8632-4771-af30-0f2b4b488164 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:32:03.754281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port a7cb53e5-8632-4771-af30-0f2b4b488164 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:32:04.808851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c182870-56a6-4baa-a10a-92da3e2fa44c None None] Network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:32:05.011880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] Provisioning for port a7cb53e5-8632-4771-af30-0f2b4b488164 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:32:05.022248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] Provisioning complete for port a7cb53e5-8632-4771-af30-0f2b4b488164 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:05.022659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.138076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 56698) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:32:05.214490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.229994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': '18d3a6e71770432ab5b33a5491589191'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:32:05.269674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] For port a7cb53e5-8632-4771-af30-0f2b4b488164, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=a7cb53e5-8632-4771-af30-0f2b4b488164,segment=NetworkSegment(a995df8c-9ef1-493f-ab17-b148440b895d),segment_id=a995df8c-9ef1-493f-ab17-b148440b895d)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:32:05.314575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.319104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:05.445655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] Pushing event updated for resources: {'Port': ['ID=a7cb53e5-8632-4771-af30-0f2b4b488164,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:05.451623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:05.480955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.policy [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=88328) register_rules /opt/stack/neutron/neutron/policy.py:68}} Nov 11 11:32:05.488854 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.quota [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Loaded quota_driver: . Nov 11 11:32:05.525943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:32:05.532316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Usage tracker for resource:router and tenant:18d3a6e71770432ab5b33a5491589191 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:32:05.536077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:32:05.544161 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:32:05.548783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-359775a0-f61e-4a99-a02f-a485bbb9c18e None None] Provisioning complete for port a7cb53e5-8632-4771-af30-0f2b4b488164 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:05.549195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-359775a0-f61e-4a99-a02f-a485bbb9c18e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.595951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.597760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.623819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device a7cb53e5-8632-4771-af30-0f2b4b488164 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:32:05.705641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.761247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port a7cb53e5-8632-4771-af30-0f2b4b488164 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:05.761671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.868278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.930786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:05.932170 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-58a16f66-b23b-4ea5-b686-e606c7d9658c admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.7930069 Nov 11 11:32:08.180236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56712) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:32:08.260790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [None req-b50fec0f-4813-4b55-bf8c-f3039ed5c967 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:32:08.261895 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b50fec0f-4813-4b55-bf8c-f3039ed5c967 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.0805671 Nov 11 11:32:09.970896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d19e18f6-c175-498b-9032-4d5f3aa5dd58 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:10.542519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56724) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:32:10.627385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Request body: {'network': {'router:external': True, 'provider:physical_network': 'physnet1', 'provider:network_type': 'flat', 'is_default': True, 'admin_state_up': True, 'name': 'public'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:32:10.633725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:32:10.638046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Usage tracker for resource:network and tenant:a02628e0c7ca4087b444fea3b13a9a5e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:32:10.641321 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:32:10.647912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:32:10.890887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Made reservation on behalf of a02628e0c7ca4087b444fea3b13a9a5e for: {'network': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:32:10.895777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:10.909645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:11.061871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:32:11.067259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Usage tracker for resource:security_group_rule and tenant:a02628e0c7ca4087b444fea3b13a9a5e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:32:11.071330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:32:11.079220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:32:11.261153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:11.273170 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:11.313492 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:11.319456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:11.364007 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ce631f0-96fb-45e0-8451-1561c08394be,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:11.369750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:11.387928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Reserving flat network on physical network physnet1 {{(pid=88329) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:101}} Nov 11 11:32:11.456578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:11.457332 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Added segment a23adfd8-0d68-4b14-aea4-d4df5cdbf1da of type flat for network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 Nov 11 11:32:11.595244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:11.662146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:11.663620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:32:11.664308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:11.669729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:11.791438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Pushing event updated for resources: {'Network': ['ID=f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:11.794370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:11.804168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:32:11.823811 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 1.2795899 Nov 11 11:32:13.402496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:13.439023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15930532-d3c8-4a16-abaa-1334169810f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:14.117624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 56736) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:32:14.311988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad92c7b0-c84e-47ab-a583-02e0e5aadd04 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:32:14.314586 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ad92c7b0-c84e-47ab-a583-02e0e5aadd04 admin admin] 10.222.0.11 "GET /v2.0/subnets/581b2ab6-6bb0-4e99-b28d-d754f1bd327b HTTP/1.1" status: 200 len: 849 time: 0.1956172 Nov 11 11:32:14.486104 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b9d02b29-c798-4c53-b172-43ac99e356eb admin admin] 10.222.0.11 "GET /v2.0/routers/61d74fbd-0fb9-48d8-ab82-50b3486aca86 HTTP/1.1" status: 200 len: 704 time: 0.1651039 Nov 11 11:32:14.536218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:15.128607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:15.421527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Allocated IP 172.20.0.1 (ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7/581b2ab6-6bb0-4e99-b28d-d754f1bd327b/e4252863-0d89-4a8f-ac27-3c45776ca638) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:32:15.769957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:15.791801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Transition to ACTIVE for port object e4252863-0d89-4a8f-ac27-3c45776ca638 will not be triggered until provisioned by entity DHCP. {{(pid=88328) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:32:15.913752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:15.919529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:15.985114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:32:15.988198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:32:16.026089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Pushing event updated for resources: {'Port': ['ID=e4252863-0d89-4a8f-ac27-3c45776ca638,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:16.037236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:32:16.037798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:16.041612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.041996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.042373 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.042712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.043078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.043484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.043884 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.044176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.044536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.044897 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.045254 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Tracked resource versions report: Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: pushed versions: Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: { 'ConntrackHelper': {'1.0'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': {'1.0'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': {'1.1'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': {'1.5'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': {'1.2'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': {'1.8'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': {'1.2'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': {'1.0'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': {'1.0'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': {'1.1'}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': {'1.1'}} Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: consumer versions: Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: { DHCP agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: L3 agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: Metadata agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: Metering agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: Open vSwitch agent@dv-cinder-817417-1-iscsi: { 'ConntrackHelper': '1.0', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': '1.0', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': '1.1', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': '1.5', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': '1.2', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': '1.8', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': '1.2', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': '1.0', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': '1.0', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': '1.1', Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': '1.1'}} Nov 11 11:32:16.046383 dv-cinder-817417-1-iscsi neutron-server[88215]: {{(pid=88328) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Nov 11 11:32:16.053472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:16.253301 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:16.404625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-fff7a478-7ffc-4f2d-b865-565dc53576fe None None] Provisioning for port e4252863-0d89-4a8f-ac27-3c45776ca638 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:32:16.410271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-fff7a478-7ffc-4f2d-b865-565dc53576fe None None] Provisioning complete for port e4252863-0d89-4a8f-ac27-3c45776ca638 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:16.410642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fff7a478-7ffc-4f2d-b865-565dc53576fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:16.467772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-fff7a478-7ffc-4f2d-b865-565dc53576fe None None] Port e4252863-0d89-4a8f-ac27-3c45776ca638 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:32:16.637381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:16.673234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:16.674468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:16.678526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:16.775274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Pushing event updated for resources: {'Port': ['ID=e4252863-0d89-4a8f-ac27-3c45776ca638,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:16.778449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:16.906274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:32:16.907420 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:32:17.203562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-43c3a0ea-b205-4bd7-a6c8-ab24377be22a None None] Provisioning complete for port e4252863-0d89-4a8f-ac27-3c45776ca638 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:17.204261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-43c3a0ea-b205-4bd7-a6c8-ab24377be22a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:17.314257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-43c3a0ea-b205-4bd7-a6c8-ab24377be22a None None] Port e4252863-0d89-4a8f-ac27-3c45776ca638 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:32:17.502166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Router 61d74fbd-0fb9-48d8-ab82-50b3486aca86 is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88328) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:32:17.690173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:32:17.702468 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] 10.222.0.11 "PUT /v2.0/routers/61d74fbd-0fb9-48d8-ab82-50b3486aca86/add_router_interface HTTP/1.1" status: 200 len: 508 time: 3.2092071 Nov 11 11:32:17.703466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Sync routers for ids ['61d74fbd-0fb9-48d8-ab82-50b3486aca86'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:32:17.725772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Routers {'61d74fbd-0fb9-48d8-ab82-50b3486aca86'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:32:17.726855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:32:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['61d74fbd-0fb9-48d8-ab82-50b3486aca86'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:32:17.991087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Set router 61d74fbd-0fb9-48d8-ab82-50b3486aca86 gateway port host: None {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:32:18.587360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'name': 'router1', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:32:05Z', 'updated_at': '2021-11-11T11:32:16Z', 'revision_number': 2, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'gw_port_host': None, '_interfaces': [{'id': 'e4252863-0d89-4a8f-ac27-3c45776ca638', 'name': '', 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'mac_address': 'fa:16:3e:1c:c5:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:15Z', 'updated_at': '2021-11-11T11:32:16Z', 'revision_number': 2, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'subnets': [{'id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '245a89ea-be0e-48e1-8f16-37292282e7ff'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:32:18.593835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Checking router: 61d74fbd-0fb9-48d8-ab82-50b3486aca86 for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:32:18.594524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Updating router 61d74fbd-0fb9-48d8-ab82-50b3486aca86 port e4252863-0d89-4a8f-ac27-3c45776ca638 binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:32:18.654289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:19.125492 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:19.142562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Transition to ACTIVE for port object e4252863-0d89-4a8f-ac27-3c45776ca638 will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:32:19.204795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:19.210770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:19.415485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Pushing event updated for resources: {'Port': ['ID=e4252863-0d89-4a8f-ac27-3c45776ca638,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:19.473249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.473637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.474012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.474381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.474745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.475107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.475495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.475864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.476224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.476580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.476936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Tracked resource versions report: Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: pushed versions: Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: { 'ConntrackHelper': {'1.0'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': {'1.0'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': {'1.1'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': {'1.5'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': {'1.2'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': {'1.8'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': {'1.2'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': {'1.0'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': {'1.0'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': {'1.1'}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': {'1.1'}} Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: consumer versions: Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: { DHCP agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: L3 agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: Metadata agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: Metering agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: Open vSwitch agent@dv-cinder-817417-1-iscsi: { 'ConntrackHelper': '1.0', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': '1.0', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': '1.1', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': '1.5', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': '1.2', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': '1.8', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': '1.2', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': '1.0', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': '1.0', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': '1.1', Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': '1.1'}} Nov 11 11:32:19.478175 dv-cinder-817417-1-iscsi neutron-server[88215]: {{(pid=88331) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Nov 11 11:32:19.484992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:19.485900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Attempting to bind port e4252863-0d89-4a8f-ac27-3c45776ca638 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:32:19.486335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Attempting to bind port e4252863-0d89-4a8f-ac27-3c45776ca638 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:32:19.486774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Attempting to bind port e4252863-0d89-4a8f-ac27-3c45776ca638 on network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:32:19.496717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 32, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:32:19.496717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Checking segment: {'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:32:19.497122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:19.497553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Bound using segment: {'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:32:19.498116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Bound port: e4252863-0d89-4a8f-ac27-3c45776ca638, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a995df8c-9ef1-493f-ab17-b148440b895d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1002, 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:32:19.498537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:19.620359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] For port e4252863-0d89-4a8f-ac27-3c45776ca638, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:32:19.626252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] For port e4252863-0d89-4a8f-ac27-3c45776ca638, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=e4252863-0d89-4a8f-ac27-3c45776ca638,segment=NetworkSegment(a995df8c-9ef1-493f-ab17-b148440b895d),segment_id=a995df8c-9ef1-493f-ab17-b148440b895d)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:32:19.747902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:19.752720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:19.860428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Pushing event updated for resources: {'Port': ['ID=e4252863-0d89-4a8f-ac27-3c45776ca638,revision_number=4']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:19.866099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:19.870995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Routers {'61d74fbd-0fb9-48d8-ab82-50b3486aca86'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:32:19.871752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:32:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['61d74fbd-0fb9-48d8-ab82-50b3486aca86'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:32:20.093691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 56754) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:32:20.187379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] Set router 61d74fbd-0fb9-48d8-ab82-50b3486aca86 gateway port host: None {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:32:20.306094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce45dd7d-8fbf-46b6-bd6d-dc2f9319a8d9 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:32:20.308062 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ce45dd7d-8fbf-46b6-bd6d-dc2f9319a8d9 admin admin] 10.222.0.11 "GET /v2.0/networks/f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 HTTP/1.1" status: 200 len: 842 time: 0.2130880 Nov 11 11:32:20.319394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'public-subnet', 'gateway_ip': '172.27.3.1', 'enable_dhcp': False, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'cidr': '172.27.3.0/24'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:32:20.327773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:32:20.334673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Usage tracker for resource:subnet and tenant:a02628e0c7ca4087b444fea3b13a9a5e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:32:20.338157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:32:20.350453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:32:20.405453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Made reservation on behalf of a02628e0c7ca4087b444fea3b13a9a5e for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:32:20.414627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:20.653030 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'name': 'router1', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:32:05Z', 'updated_at': '2021-11-11T11:32:16Z', 'revision_number': 2, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'gw_port_host': None, '_interfaces': [{'id': 'e4252863-0d89-4a8f-ac27-3c45776ca638', 'name': '', 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'mac_address': 'fa:16:3e:1c:c5:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:15Z', 'updated_at': '2021-11-11T11:32:19Z', 'revision_number': 4, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'subnets': [{'id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '245a89ea-be0e-48e1-8f16-37292282e7ff'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:32:20.657714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0904a09-1675-43ca-9085-8e58d99784c2 None None] The sync data for ids ['61d74fbd-0fb9-48d8-ab82-50b3486aca86'] in dv-cinder-817417-1-iscsi is: [{'id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'name': 'router1', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:32:05Z', 'updated_at': '2021-11-11T11:32:16Z', 'revision_number': 2, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'gw_port_host': None, '_interfaces': [{'id': 'e4252863-0d89-4a8f-ac27-3c45776ca638', 'name': '', 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'mac_address': 'fa:16:3e:1c:c5:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:15Z', 'updated_at': '2021-11-11T11:32:19Z', 'revision_number': 4, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'subnets': [{'id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '245a89ea-be0e-48e1-8f16-37292282e7ff'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:32:21.248088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:21.252552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:21.333483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Pushing event updated for resources: {'Subnet': ['ID=168d25bd-1d7e-499b-bc86-5ae1423a4145,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:21.337087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:21.350863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:32:21.351503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Network hostable DHCP agents. Network: f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:32:21.438765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:32:21.535875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:32:21.540902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:32:21.541898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:21.545424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a7c2051-3ac9-4ad9-b692-e4d725583b2f None None] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:32:21.600202 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2850616 Nov 11 11:32:21.800248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89e35e32-6411-4de6-89a5-3236b7e8dca3 None None] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:32:23.654682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device e4252863-0d89-4a8f-ac27-3c45776ca638 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:32:23.769904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port e4252863-0d89-4a8f-ac27-3c45776ca638 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:32:23.775653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port e4252863-0d89-4a8f-ac27-3c45776ca638 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:23.776071 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:23.907705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:23.974458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port e4252863-0d89-4a8f-ac27-3c45776ca638, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=e4252863-0d89-4a8f-ac27-3c45776ca638,segment=NetworkSegment(a995df8c-9ef1-493f-ab17-b148440b895d),segment_id=a995df8c-9ef1-493f-ab17-b148440b895d)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:32:23.978090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 56770) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:32:24.027723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:24.032847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-46d0e23b-5353-4e01-bdf7-2870b46284f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:24.103712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=e4252863-0d89-4a8f-ac27-3c45776ca638,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:24.107237 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:24.250491 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ef0d1385-1104-492e-865a-f00789627306 admin admin] 10.222.0.11 "GET /v2.0/routers/61d74fbd-0fb9-48d8-ab82-50b3486aca86 HTTP/1.1" status: 200 len: 710 time: 0.2709334 Nov 11 11:32:24.497315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-712c6db6-e28b-4bd3-a06f-ec7ec4d563f5 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:32:24.498838 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-712c6db6-e28b-4bd3-a06f-ec7ec4d563f5 admin admin] 10.222.0.11 "GET /v2.0/networks/f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 HTTP/1.1" status: 200 len: 886 time: 0.2415521 Nov 11 11:32:24.514176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:32:25.238621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:25.492358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:25.562355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:25.632948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device e4252863-0d89-4a8f-ac27-3c45776ca638 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:32:25.716392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Allocated IP 172.27.3.115 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/09418cc0-6dab-46e8-8e75-27b57a1c12fd) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:32:25.730009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port e4252863-0d89-4a8f-ac27-3c45776ca638 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:25.730428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:25.889594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:25.964821 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:25.969398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-31809db1-7906-4014-9c8b-0087164b5b73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:26.031378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:32:26.039931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:32:26.045982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:32:26.079257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Pushing event updated for resources: {'Port': ['ID=09418cc0-6dab-46e8-8e75-27b57a1c12fd,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:26.088802 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:26.307302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:26.490179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:26.494114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-4039249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change--9223372036850736602', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3891079'] for router, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:26.712219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Router 61d74fbd-0fb9-48d8-ab82-50b3486aca86 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:32:26.938683 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:32:26.948608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:26.949939 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] 10.222.0.11 "PUT /v2.0/routers/61d74fbd-0fb9-48d8-ab82-50b3486aca86 HTTP/1.1" status: 200 len: 890 time: 2.4398699 Nov 11 11:32:26.951083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Sync routers for ids ['61d74fbd-0fb9-48d8-ab82-50b3486aca86'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:32:26.966296 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Routers {'61d74fbd-0fb9-48d8-ab82-50b3486aca86'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:32:26.967000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:32:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['61d74fbd-0fb9-48d8-ab82-50b3486aca86'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:32:27.184429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Set router 61d74fbd-0fb9-48d8-ab82-50b3486aca86 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:32:27.729756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'name': 'router1', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': '09418cc0-6dab-46e8-8e75-27b57a1c12fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:32:05Z', 'updated_at': '2021-11-11T11:32:26Z', 'revision_number': 4, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'gw_port': {'id': '09418cc0-6dab-46e8-8e75-27b57a1c12fd', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:69:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:25Z', 'updated_at': '2021-11-11T11:32:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'e4252863-0d89-4a8f-ac27-3c45776ca638', 'name': '', 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'mac_address': 'fa:16:3e:1c:c5:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:15Z', 'updated_at': '2021-11-11T11:32:23Z', 'revision_number': 5, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'subnets': [{'id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '245a89ea-be0e-48e1-8f16-37292282e7ff'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:32:27.740128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Checking router: 61d74fbd-0fb9-48d8-ab82-50b3486aca86 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:32:27.740786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Updating router 61d74fbd-0fb9-48d8-ab82-50b3486aca86 port 09418cc0-6dab-46e8-8e75-27b57a1c12fd binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:32:27.829690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:28.235759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:28.256155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Transition to ACTIVE for port object 09418cc0-6dab-46e8-8e75-27b57a1c12fd will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:32:28.335770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:28.340927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:28.438994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fdde856-1aa8-4a0b-acf3-30dfb8466431 None None] Pushing event updated for resources: {'Port': ['ID=09418cc0-6dab-46e8-8e75-27b57a1c12fd,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:28.443559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Attempting to bind port 09418cc0-6dab-46e8-8e75-27b57a1c12fd on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:32:28.443974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Attempting to bind port 09418cc0-6dab-46e8-8e75-27b57a1c12fd by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:32:28.444391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Attempting to bind port 09418cc0-6dab-46e8-8e75-27b57a1c12fd on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:32:28.447266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9fdde856-1aa8-4a0b-acf3-30dfb8466431 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:28.453646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 32, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:32:28.454068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:32:28.454498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:28.454974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:32:28.455551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Bound port: 09418cc0-6dab-46e8-8e75-27b57a1c12fd, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:32:28.455979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:28.545394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] For port 09418cc0-6dab-46e8-8e75-27b57a1c12fd, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:32:28.549648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] For port 09418cc0-6dab-46e8-8e75-27b57a1c12fd, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=09418cc0-6dab-46e8-8e75-27b57a1c12fd,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:32:28.587879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:28.593164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05f3ef0a-2461-453e-9309-e8163280dfba None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:28.682415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fdde856-1aa8-4a0b-acf3-30dfb8466431 None None] Pushing event updated for resources: {'Port': ['ID=09418cc0-6dab-46e8-8e75-27b57a1c12fd,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:28.687294 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9fdde856-1aa8-4a0b-acf3-30dfb8466431 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:28.688466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Routers {'61d74fbd-0fb9-48d8-ab82-50b3486aca86'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:32:28.689157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:32:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['61d74fbd-0fb9-48d8-ab82-50b3486aca86'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:32:28.896057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] Set router 61d74fbd-0fb9-48d8-ab82-50b3486aca86 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:32:29.453539 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'name': 'router1', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': '09418cc0-6dab-46e8-8e75-27b57a1c12fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:32:05Z', 'updated_at': '2021-11-11T11:32:26Z', 'revision_number': 4, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'gw_port': {'id': '09418cc0-6dab-46e8-8e75-27b57a1c12fd', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:69:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:25Z', 'updated_at': '2021-11-11T11:32:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'e4252863-0d89-4a8f-ac27-3c45776ca638', 'name': '', 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'mac_address': 'fa:16:3e:1c:c5:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:15Z', 'updated_at': '2021-11-11T11:32:23Z', 'revision_number': 5, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'subnets': [{'id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '245a89ea-be0e-48e1-8f16-37292282e7ff'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:32:29.459035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-776cc799-8bd8-42e0-a83e-b284a88d8b0b None None] The sync data for ids ['61d74fbd-0fb9-48d8-ab82-50b3486aca86'] in dv-cinder-817417-1-iscsi is: [{'id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'name': 'router1', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': '09418cc0-6dab-46e8-8e75-27b57a1c12fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:32:05Z', 'updated_at': '2021-11-11T11:32:26Z', 'revision_number': 4, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'gw_port': {'id': '09418cc0-6dab-46e8-8e75-27b57a1c12fd', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:69:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:25Z', 'updated_at': '2021-11-11T11:32:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'e4252863-0d89-4a8f-ac27-3c45776ca638', 'name': '', 'network_id': 'ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7', 'tenant_id': '18d3a6e71770432ab5b33a5491589191', 'mac_address': 'fa:16:3e:1c:c5:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61d74fbd-0fb9-48d8-ab82-50b3486aca86', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:32:15Z', 'updated_at': '2021-11-11T11:32:23Z', 'revision_number': 5, 'project_id': '18d3a6e71770432ab5b33a5491589191', 'subnets': [{'id': '581b2ab6-6bb0-4e99-b28d-d754f1bd327b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '245a89ea-be0e-48e1-8f16-37292282e7ff'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:32:29.494467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 56782) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:32:29.744996 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ad9c716f-b5bd-4db0-ae98-6dd4c639ed25 admin admin] 10.222.0.11 "GET /v2.0/ports?device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 1080 time: 0.2487037 Nov 11 11:32:31.726354 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 09418cc0-6dab-46e8-8e75-27b57a1c12fd up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:32:31.884138 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 09418cc0-6dab-46e8-8e75-27b57a1c12fd completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:32:31.890451 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 09418cc0-6dab-46e8-8e75-27b57a1c12fd triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:31.892074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:32.039774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:32.073630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 09418cc0-6dab-46e8-8e75-27b57a1c12fd, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=09418cc0-6dab-46e8-8e75-27b57a1c12fd,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:32:32.114498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:32.118976 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9fdde856-1aa8-4a0b-acf3-30dfb8466431 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:32:32.258685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=09418cc0-6dab-46e8-8e75-27b57a1c12fd,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:32:32.264830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:32:33.700789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 09418cc0-6dab-46e8-8e75-27b57a1c12fd up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:32:33.856248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 09418cc0-6dab-46e8-8e75-27b57a1c12fd triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:32:33.857729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:39.543603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:32:40.011390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-70d5c295-acb2-49f2-87de-0907021cf5f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:41.296120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:43.417095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:43.461665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6ecd0122-fad6-4a09-8657-99c261e4a4a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:32:44.564488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:09.997879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-898b2c2c-9b72-4545-8094-4682aa6e9b6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:11.289725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:13.398503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:13.461233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9fa4a8d0-a2e3-40ba-a3ec-9827aaed6179 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:14.581497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:16.532607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:33:40.003909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-74dfe852-318a-4f53-8bac-bc10203a9372 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:41.278205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:43.494814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:43.533267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23e809c3-7f75-42ee-b460-c99369ffe151 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:44.545695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:33:53.526664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:34:10.003080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-153a9658-5c61-48c5-99c3-54e77c327582 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:11.289029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:13.430974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:13.471346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-52e7d790-4fa4-477c-9842-80a875500303 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:14.568513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:16.122261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57320) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:16.256451 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.pecan_wsgi.hooks.translation [None req-59f872a2-f620-4f58-b061-892c4e98b70c admin admin] GET failed (client error): The resource could not be found. Nov 11 11:34:16.257921 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-59f872a2-f620-4f58-b061-892c4e98b70c admin admin] 10.222.0.11 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.1345162 Nov 11 11:34:16.416819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22760124-a370-41ca-bc70-af07bb744cce admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:16.418656 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-22760124-a370-41ca-bc70-af07bb744cce admin admin] 10.222.0.11 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 873 time: 0.1556337 Nov 11 11:34:18.685887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57332) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:18.845860 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-939c9752-57ae-4faf-8f8d-14eeaa16ea07 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:18.846490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-939c9752-57ae-4faf-8f8d-14eeaa16ea07 admin admin] Synchronizing usage tracker for tenant:a02628e0c7ca4087b444fea3b13a9a5e on resource:subnet {{(pid=88328) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:34:18.893449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-939c9752-57ae-4faf-8f8d-14eeaa16ea07 admin admin] Unset dirty status for tenant:a02628e0c7ca4087b444fea3b13a9a5e on resource:subnet {{(pid=88328) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:34:18.894932 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-939c9752-57ae-4faf-8f8d-14eeaa16ea07 admin admin] 10.222.0.11 "GET /v2.0/subnets/581b2ab6-6bb0-4e99-b28d-d754f1bd327b HTTP/1.1" status: 200 len: 849 time: 0.2079091 Nov 11 11:34:18.906266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:34:19.052602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Notify callbacks [] for subnet, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:19.316517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8731490496678'] for subnet, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:19.321682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:34:19.376400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:19.377441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:19.379826 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] 10.222.0.11 "PUT /v2.0/subnets/581b2ab6-6bb0-4e99-b28d-d754f1bd327b HTTP/1.1" status: 200 len: 868 time: 0.4779546 Nov 11 11:34:19.395767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7badcac5-1a97-4419-81b5-fe9cea2859a9 None None] Network ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:34:19.411882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Pushing event updated for resources: {'Subnet': ['ID=581b2ab6-6bb0-4e99-b28d-d754f1bd327b,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:34:19.423240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.423628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.424014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.424395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.424766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.425142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.425516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.425886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.426252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.426649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.427015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:34:19.432096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:34:20.153455 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-98e9baf9-355e-4e19-9f4f-2a41165a7e62 None None] Provisioning complete for port e4252863-0d89-4a8f-ac27-3c45776ca638 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:34:20.154151 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-98e9baf9-355e-4e19-9f4f-2a41165a7e62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:20.404298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-98e9baf9-355e-4e19-9f4f-2a41165a7e62 None None] Provisioning complete for port a7cb53e5-8632-4771-af30-0f2b4b488164 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:34:20.404928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-98e9baf9-355e-4e19-9f4f-2a41165a7e62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:21.759500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57344) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:22.147685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4865f3b6-1c66-401a-949a-4979d4d0d3f3 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:22.148023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4865f3b6-1c66-401a-949a-4979d4d0d3f3 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:22.148846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4865f3b6-1c66-401a-949a-4979d4d0d3f3 admin admin] Synchronizing usage tracker for tenant:a02628e0c7ca4087b444fea3b13a9a5e on resource:network {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:34:22.236603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4865f3b6-1c66-401a-949a-4979d4d0d3f3 admin admin] Unset dirty status for tenant:a02628e0c7ca4087b444fea3b13a9a5e on resource:network {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:34:22.238108 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4865f3b6-1c66-401a-949a-4979d4d0d3f3 admin admin] 10.222.0.11 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.4773130 Nov 11 11:34:24.647081 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57356) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:24.902809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7f6c307-88b4-4f4d-8072-ab993521332b admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:24.903079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7f6c307-88b4-4f4d-8072-ab993521332b admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:24.904849 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d7f6c307-88b4-4f4d-8072-ab993521332b admin admin] 10.222.0.11 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.2563660 Nov 11 11:34:27.221135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57368) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:27.462457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bd5f3e7-cf1f-4a0f-b58f-a7a56174ca67 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:27.464121 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3bd5f3e7-cf1f-4a0f-b58f-a7a56174ca67 admin admin] 10.222.0.11 "GET /v2.0/networks/ee4d6ee3-1b2a-47a2-b79c-c1f6cedd46d7 HTTP/1.1" status: 200 len: 870 time: 0.2418978 Nov 11 11:34:29.795904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57380) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:30.122011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c06d6026-0287-48b8-aafc-cebd7d506fef admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:30.123483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c06d6026-0287-48b8-aafc-cebd7d506fef admin admin] 10.222.0.11 "GET /v2.0/networks/f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 HTTP/1.1" status: 200 len: 886 time: 0.3265975 Nov 11 11:34:30.533044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:34:32.332208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57392) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:32.482032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b7b2a55-055d-4d40-85cd-97414d2de15d admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:32.482448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b7b2a55-055d-4d40-85cd-97414d2de15d admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:32.484143 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5b7b2a55-055d-4d40-85cd-97414d2de15d admin admin] 10.222.0.11 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1504822 Nov 11 11:34:34.677090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57404) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:34.836628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30cd9bf7-e73d-46b1-8ea8-5b4fd9fda425 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:34.836951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30cd9bf7-e73d-46b1-8ea8-5b4fd9fda425 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:34.838654 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-30cd9bf7-e73d-46b1-8ea8-5b4fd9fda425 admin admin] 10.222.0.11 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1605160 Nov 11 11:34:37.118202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57416) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:37.319524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fd8d1bd-528e-4b32-a38e-43d39c0246e3 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:37.321163 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0fd8d1bd-528e-4b32-a38e-43d39c0246e3 admin admin] 10.222.0.11 "GET /v2.0/subnets/168d25bd-1d7e-499b-bc86-5ae1423a4145 HTTP/1.1" status: 200 len: 816 time: 0.2015333 Nov 11 11:34:39.521305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57428) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:34:39.726596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35bd924b-0584-43b5-a2e8-f9062e2efbef admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:34:39.728416 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-35bd924b-0584-43b5-a2e8-f9062e2efbef admin admin] 10.222.0.11 "GET /v2.0/subnets/581b2ab6-6bb0-4e99-b28d-d754f1bd327b HTTP/1.1" status: 200 len: 868 time: 0.2054327 Nov 11 11:34:39.984979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7cbc5e55-e9bd-4333-9863-d41f9419e881 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:41.282389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:43.430906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:43.470706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5190873a-e892-46bc-ae56-8a4fe4dc2a76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:34:44.579467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:00.754040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57476) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:35:00.839088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [None req-edaa413a-6058-4b64-b1e9-d117059235d4 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88328) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:35:00.840271 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-edaa413a-6058-4b64-b1e9-d117059235d4 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.0846438 Nov 11 11:35:03.160461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57488) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:35:03.282134 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.pecan_wsgi.hooks.translation [None req-2b7aea70-43dd-453d-bca4-dc28e10ea023 admin admin] GET failed (client error): The resource could not be found. Nov 11 11:35:03.283514 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2b7aea70-43dd-453d-bca4-dc28e10ea023 admin admin] 10.222.0.11 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.1220665 Nov 11 11:35:03.591914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e690a4c6-e835-485e-8904-2abfff5dc240 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:35:03.593510 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e690a4c6-e835-485e-8904-2abfff5dc240 admin admin] 10.222.0.11 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.3054996 Nov 11 11:35:05.770179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57500) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:35:05.854179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Request body: {'network': {'name': 'shared', 'shared': True, 'admin_state_up': True}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:35:05.859706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:35:05.870188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:35:06.024289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Made reservation on behalf of a02628e0c7ca4087b444fea3b13a9a5e for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:35:06.029113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:06.127559 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.services.revisions.revision_plugin [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Could not find related network for resource to bump revision. Nov 11 11:35:06.205435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1041} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:35:06.218054 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363305364150081', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:06.218683 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Unsubscribe: segment precommit_create {{(pid=88328) unsubscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:84}} Nov 11 11:35:06.219166 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Added segment c7e3cfb8-478a-49a8-8a62-e44b81ddec99 of type vlan for network aca53216-c72b-4292-ba2a-d0bc29443930 Nov 11 11:35:06.272353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:06.350176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:06.351711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:35:06.352520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:06.360405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:35:06.468103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Pushing event updated for resources: {'Network': ['ID=aca53216-c72b-4292-ba2a-d0bc29443930,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:35:06.472515 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:35:06.481031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network aca53216-c72b-4292-ba2a-d0bc29443930 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:35:06.539181 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 848 time: 0.7602005 Nov 11 11:35:07.541870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:35:08.737025 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57512) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:35:08.840776 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.pecan_wsgi.hooks.translation [None req-ec5dd283-40cc-4da7-8bbc-d1ad224163eb admin admin] GET failed (client error): The resource could not be found. Nov 11 11:35:08.841315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ec5dd283-40cc-4da7-8bbc-d1ad224163eb admin admin] Synchronizing usage tracker for tenant:a02628e0c7ca4087b444fea3b13a9a5e on resource:network {{(pid=88328) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:35:08.881457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ec5dd283-40cc-4da7-8bbc-d1ad224163eb admin admin] Unset dirty status for tenant:a02628e0c7ca4087b444fea3b13a9a5e on resource:network {{(pid=88328) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:35:08.882735 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ec5dd283-40cc-4da7-8bbc-d1ad224163eb admin admin] 10.222.0.11 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.1445642 Nov 11 11:35:09.004334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e3d003d-7697-478a-b194-e2b7e44313dc admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:35:09.005939 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6e3d003d-7697-478a-b194-e2b7e44313dc admin admin] 10.222.0.11 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 827 time: 0.1187923 Nov 11 11:35:09.016994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930', 'ip_version': 4, 'name': 'shared-subnet', 'description': 'shared-subnet'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:35:09.022234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:35:09.032725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:35:09.070163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Made reservation on behalf of a02628e0c7ca4087b444fea3b13a9a5e for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:35:09.075008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Notify callbacks [] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:09.327357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:09.331687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8de9b491-6ecb-4b4b-91a8-44c4d178fe2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:35:09.408190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Pushing event updated for resources: {'Subnet': ['ID=e1145c7e-4bad-4396-9274-f75f0d69f336,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:35:09.413410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:35:09.424443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Checking segment: {'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:35:09.424831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Network hostable DHCP agents. Network: aca53216-c72b-4292-ba2a-d0bc29443930, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:35:09.481149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Network aca53216-c72b-4292-ba2a-d0bc29443930 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:35:09.549468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, aca53216-c72b-4292-ba2a-d0bc29443930) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:35:09.553881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:35:09.554530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:09.560816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab9f0667-42b4-40ba-8134-dd36cd6fe743 None None] Network aca53216-c72b-4292-ba2a-d0bc29443930 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:35:09.682414 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6693401 Nov 11 11:35:09.797332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-aca53216-c72b-4292-ba2a-d0bc29443930', 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930', 'tenant_id': 'a02628e0c7ca4087b444fea3b13a9a5e', 'fixed_ips': [{'subnet_id': 'e1145c7e-4bad-4396-9274-f75f0d69f336'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:35:09.798962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:09.992172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Allocated IP 192.168.233.2 (aca53216-c72b-4292-ba2a-d0bc29443930/e1145c7e-4bad-4396-9274-f75f0d69f336/9836863f-ef46-4abe-b648-97f01e69a1b4) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:35:10.013474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fe4180a5-cde6-405e-b5fd-74f405c3fa62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:10.476240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:10.489766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Transition to ACTIVE for port object 9836863f-ef46-4abe-b648-97f01e69a1b4 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:35:10.525982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Transition to ACTIVE for port object 9836863f-ef46-4abe-b648-97f01e69a1b4 will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:35:10.573289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:10.579361 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:35:10.652143 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Network aca53216-c72b-4292-ba2a-d0bc29443930 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:35:10.656107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:35:10.658748 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:35:10.661542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Pushing event updated for resources: {'Port': ['ID=9836863f-ef46-4abe-b648-97f01e69a1b4,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:35:10.674826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.675211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.675592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.675970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.676341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.676697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.677044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.677421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.677783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.678139 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.678493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:35:10.682551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:35:10.770021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Attempting to bind port 9836863f-ef46-4abe-b648-97f01e69a1b4 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:35:10.770358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Attempting to bind port 9836863f-ef46-4abe-b648-97f01e69a1b4 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:35:10.770765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Attempting to bind port 9836863f-ef46-4abe-b648-97f01e69a1b4 on network aca53216-c72b-4292-ba2a-d0bc29443930 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:35:10.778973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 34, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:35:10.779440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Checking segment: {'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:35:10.797366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:10.797366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Bound using segment: {'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:35:10.797366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Bound port: 9836863f-ef46-4abe-b648-97f01e69a1b4, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:35:10.797366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:10.885181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] For port 9836863f-ef46-4abe-b648-97f01e69a1b4, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:35:10.889038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] For port 9836863f-ef46-4abe-b648-97f01e69a1b4, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=9836863f-ef46-4abe-b648-97f01e69a1b4,segment=NetworkSegment(c7e3cfb8-478a-49a8-8a62-e44b81ddec99),segment_id=c7e3cfb8-478a-49a8-8a62-e44b81ddec99)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:35:10.970092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:10.978467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:35:11.064773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Pushing event updated for resources: {'Port': ['ID=9836863f-ef46-4abe-b648-97f01e69a1b4,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:35:11.068801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:35:11.282121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:11.734275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 9836863f-ef46-4abe-b648-97f01e69a1b4 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:35:11.847548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 9836863f-ef46-4abe-b648-97f01e69a1b4 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:35:12.590374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16e11060-9e74-46d0-954e-41ce27f63bbe None None] Network aca53216-c72b-4292-ba2a-d0bc29443930 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:35:12.764392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] Provisioning for port 9836863f-ef46-4abe-b648-97f01e69a1b4 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:35:12.782319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] Provisioning complete for port 9836863f-ef46-4abe-b648-97f01e69a1b4 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:35:12.782724 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:12.971500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:13.014672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] For port 9836863f-ef46-4abe-b648-97f01e69a1b4, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=9836863f-ef46-4abe-b648-97f01e69a1b4,segment=NetworkSegment(c7e3cfb8-478a-49a8-8a62-e44b81ddec99),segment_id=c7e3cfb8-478a-49a8-8a62-e44b81ddec99)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:35:13.070482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:13.073892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:35:13.158369 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] Pushing event updated for resources: {'Port': ['ID=9836863f-ef46-4abe-b648-97f01e69a1b4,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:35:13.168549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:35:13.302243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-2e6fb26e-7aa2-46a4-bcdc-26ea0dedf663 None None] Provisioning complete for port 9836863f-ef46-4abe-b648-97f01e69a1b4 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:35:13.302659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2e6fb26e-7aa2-46a4-bcdc-26ea0dedf663 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:13.525504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:13.567487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ae4d104f-3cd6-4c82-b2c4-2d25bb322de6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:13.723521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 9836863f-ef46-4abe-b648-97f01e69a1b4 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:35:13.795911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 9836863f-ef46-4abe-b648-97f01e69a1b4 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:35:13.796351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:14.538417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:39.978102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1b952890-034a-48c1-b176-53d6572f76c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:41.280262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:43.434198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:43.474916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f54b328f-3485-49f7-9905-7fdebdaf0883 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:35:44.532995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:35:44.561164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:09.993968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d3d7389c-0b9d-4f73-a7b8-3a8095d4dddb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:11.309340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:13.434844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:13.479411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b447b9ce-4442-49e2-b015-4a2e34c462c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:14.582979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:21.533865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:36:28.075724 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57546) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:36:28.081945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [None req-a17ff4bc-8205-4c1a-b03a-8cb1387e2780 tempest-verify_tempest_config-1624588060 tempest-verify_tempest_config-1624588060-project] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88328) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:36:28.083053 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a17ff4bc-8205-4c1a-b03a-8cb1387e2780 tempest-verify_tempest_config-1624588060 tempest-verify_tempest_config-1624588060-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12156 time: 0.0062287 Nov 11 11:36:28.655680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57564) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:36:28.809541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:28.850280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:36:28.854193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Usage tracker for resource:security_group_rule and tenant:ca9655a1ca88468294853f811aed0957 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:36:28.857145 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:36:28.862924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:36:29.111225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:29.148430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:29.156670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:36:29.198074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8dd71b8d-0ae7-400b-a575-980cb1ba432c,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:36:29.206363 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ca9655a1ca88468294853f811aed0957&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5496166 Nov 11 11:36:29.209740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57570) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:36:29.210042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.210421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.210790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.211179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.211542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.211900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.212271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.212627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.212988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.213338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.213691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.218266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:36:29.276279 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:29.308808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:29.571221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:29.575562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:36:29.587364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8dd71b8d-0ae7-400b-a575-980cb1ba432c,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:36:29.600338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.600729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.601099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.601466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.601837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.602201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.602564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.602930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.603322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.603682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.604039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:36:29.607292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:29.608502 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8dd71b8d-0ae7-400b-a575-980cb1ba432c HTTP/1.1" status: 204 len: 168 time: 0.3976746 Nov 11 11:36:29.609443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:36:39.977467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-90e8b965-b022-41a2-8186-4e87a2b85f2a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:41.278827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:43.432490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:43.455179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-69c113a6-1f41-4893-86ed-e980b0e8c5c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:44.577474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:36:58.535551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:37:09.982996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-adb4201b-f6f6-425c-ac98-5e2fe779f1b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:11.273494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:13.449472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:13.475713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23035cb9-f43c-47b2-9652-f8d3889f5e24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:14.598439 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:35.536921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 5 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:37:39.982177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2e6f2c0b-98c3-45b8-8045-6bf76917d2b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:41.284659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:43.467707 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:43.501810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5a202923-51c7-427f-9d6c-bbbeae8df7fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:37:44.581616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:03.140416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports--9223372036850728341'] for agent, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:09.987461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f75c0d17-b9ea-4768-98d3-c98a0039ead2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:11.284382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:12.538000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:38:13.445416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-daa2e7cf-0dc7-484c-a080-10a742fb8bc4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:13.472719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:14.575696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:19.330652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57650) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:38:19.566585 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9a838df3-15d1-4cd1-a784-7e2836aa3795 admin admin] 10.222.0.11 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.2345381 Nov 11 11:38:21.712777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57662) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:38:21.811063 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6ce5ae15-3632-478c-9d6a-eb5161e7ce94 admin admin] 10.222.0.11 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0970874 Nov 11 11:38:33.141274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:39.997948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c7b944c7-499e-4d86-a503-566a8c525186 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:41.278657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:43.461254 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:43.506311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b2edb0e8-23f1-4c38-82f7-8af80855dbfa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:44.596345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:38:49.539369 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:39:03.140373 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:09.991642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-986996d9-d361-4877-93e5-f8c799651f41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:11.294480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:13.446641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f336a96a-4294-4f05-a3b8-e542b26395f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:13.477275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:14.591748 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:26.540523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:39:33.386241 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:40.012070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d14465c6-7713-4350-8d96-46bd401bd441 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:41.305969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:43.457606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e148f2bb-42f7-4ca2-aaae-b167962a7dea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:43.509082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:39:44.604218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:03.145467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:03.541276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:40:09.065496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57822) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:09.634346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-2030184733-network', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:09.643364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:09.649485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Usage tracker for resource:network and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:09.654804 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:09.663975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:09.711674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Made reservation on behalf of 307ee8e0c17a4e1ebce8db1a0c8ca6be for: {'network': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:09.717816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:09.736184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:09.779733 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:09.779733 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Usage tracker for resource:security_group_rule and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:09.780906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:09.789127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:09.997766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:10.048879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-897fe82c-a6ba-4147-bf73-0b4e6dac9ea5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:10.082929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:10.091628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:10.151016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1007} {{(pid=88329) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:40:10.161955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4db15c24-2409-4404-b91c-2c6017946896,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:10.183954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:10.184609 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Added segment 42c776fe-664f-4fda-a846-8702497a4e04 of type vlan for network 6f90028e-6513-4ec3-884d-7830777c7626 Nov 11 11:40:10.188541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Tracked resource versions report: Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: pushed versions: Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: { 'ConntrackHelper': {'1.0'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': {'1.0'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': {'1.1'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': {'1.5'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': {'1.2'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': {'1.8'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': {'1.2'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': {'1.0'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': {'1.0'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': {'1.1'}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': {'1.1'}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: consumer versions: Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: { DHCP agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: HyperV agent@hv-cinder-81741: {}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: L3 agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: Metadata agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: Metering agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: Open vSwitch agent@dv-cinder-817417-1-iscsi: { 'ConntrackHelper': '1.0', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': '1.0', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': '1.1', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': '1.5', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': '1.2', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': '1.8', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': '1.2', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': '1.0', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': '1.0', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': '1.1', Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': '1.1'}} Nov 11 11:40:10.203375 dv-cinder-817417-1-iscsi neutron-server[88215]: {{(pid=88329) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Nov 11 11:40:10.208126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:10.291828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:10.357209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:10.358543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:10.359244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:10.370142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:10.560554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57864) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:10.561111 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.4939437 Nov 11 11:40:10.567992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Request body: {'subnet': {'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-2030184733-subnet', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:10.573158 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Pushing event updated for resources: {'Network': ['ID=6f90028e-6513-4ec3-884d-7830777c7626,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:10.577108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:10.586476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 6f90028e-6513-4ec3-884d-7830777c7626 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:40:10.589284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:10.595888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Usage tracker for resource:subnet and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:10.600702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:10.609063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:10.660636 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Made reservation on behalf of 307ee8e0c17a4e1ebce8db1a0c8ca6be for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:10.667510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.095575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57880) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:11.137414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57886) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:11.248390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.253272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-294a9fc0-02b6-4127-8e8d-a1cef5f8f36a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:11.322501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.324234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f175d5dc-0139-4051-bd21-8da204b3ae78,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:11.351042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.351347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.351727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.352086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.352468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.352867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.353225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.353591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.353956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.354306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.354692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Tracked resource versions report: Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: pushed versions: Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: { 'ConntrackHelper': {'1.0'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': {'1.0'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': {'1.1'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': {'1.5'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': {'1.2'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': {'1.8'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': {'1.2'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': {'1.0'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': {'1.0'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': {'1.1'}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': {'1.1'}} Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: consumer versions: Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: { DHCP agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: HyperV agent@hv-cinder-81741: {}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: L3 agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: Metadata agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: Metering agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: Open vSwitch agent@dv-cinder-817417-1-iscsi: { 'ConntrackHelper': '1.0', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': '1.0', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': '1.1', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': '1.5', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': '1.2', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': '1.8', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': '1.2', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': '1.0', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': '1.0', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': '1.1', Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': '1.1'}} Nov 11 11:40:11.356020 dv-cinder-817417-1-iscsi neutron-server[88215]: {{(pid=88328) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Nov 11 11:40:11.362001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:11.374890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Checking segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:11.375314 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Network hostable DHCP agents. Network: 6f90028e-6513-4ec3-884d-7830777c7626, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:40:11.470061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Network 6f90028e-6513-4ec3-884d-7830777c7626 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:40:11.542148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57898) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:11.551039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 6f90028e-6513-4ec3-884d-7830777c7626) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:11.555782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:11.556684 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.564536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac0aad90-3ddd-4252-b113-085e24a65c75 None None] Network 6f90028e-6513-4ec3-884d-7830777c7626 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:11.722572 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1599734 Nov 11 11:40:11.725363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57906) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:11.733528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:11.736289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-network', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:11.741863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:11.743542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:11.748385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Usage tracker for resource:router and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:11.753431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Usage tracker for resource:network and tenant:d45efb8e286d41399941bdf844af2b3c is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:11.753782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:11.760442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:11.763992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:11.769583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:11.811438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Made reservation on behalf of d45efb8e286d41399941bdf844af2b3c for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:11.820197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.836607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-615335580-network', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:11.837214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.838496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.844690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:11.847470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.852795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-6f90028e-6513-4ec3-884d-7830777c7626', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:40:11.853959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.860910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Usage tracker for resource:network and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:11.865948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:11.877190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:11.966613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:11.988659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:11.993057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Usage tracker for resource:security_group_rule and tenant:d45efb8e286d41399941bdf844af2b3c is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:11.997238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:12.017862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:12.069048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Allocated IP 172.20.0.2 (6f90028e-6513-4ec3-884d-7830777c7626/f175d5dc-0139-4051-bd21-8da204b3ae78/f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:12.071681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Made reservation on behalf of 49b88e3cf8f748be91f37e0b9caccf6d for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:12.081581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-297016562-network', 'tenant_id': '494d10266beb49e2a9a6952aeefc82ef'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:12.084517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.093228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:12.099491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Usage tracker for resource:network and tenant:494d10266beb49e2a9a6952aeefc82ef is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:12.107310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.111106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:12.210876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:12.286704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:12.301483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Usage tracker for resource:security_group_rule and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:12.309183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:12.319473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.320840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:12.326794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.374256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Made reservation on behalf of 494d10266beb49e2a9a6952aeefc82ef for: {'network': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:12.380639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.390090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.412028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:12.446480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.449628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1021} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:40:12.453476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.471671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.508810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.537657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Transition to ACTIVE for port object f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:12.547203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.549409 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Added segment 908260cd-8125-4712-af58-79f96aa8b762 of type vlan for network d616b076-b5a7-4954-b999-21a3b4c0cf2f Nov 11 11:40:12.581483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Transition to ACTIVE for port object f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:12.582309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1022} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:40:12.594840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:12.599099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:12.605419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.093s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:12.661113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.661420 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1e88d09-ccec-4ca3-b694-06c4b4f9cd28,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:12.666359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:12.671688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:12.686187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Usage tracker for resource:security_group_rule and tenant:494d10266beb49e2a9a6952aeefc82ef is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:12.690346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:12.694104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:12.697923 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.698246 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Added segment 421843b6-0528-41c4-b114-9384539ecc53 of type vlan for network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 Nov 11 11:40:12.709009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:12.718789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.786997 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.815741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.833327 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Network 6f90028e-6513-4ec3-884d-7830777c7626 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:12.838501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:12.841524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Pushing event updated for resources: {'Port': ['ID=f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:12.848247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:12.861868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.862494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.863047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.863614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.864123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.864696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.865370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.866194 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.867017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.867860 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.868672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Tracked resource versions report: Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: pushed versions: Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: { 'ConntrackHelper': {'1.0'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': {'1.0'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': {'1.1'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': {'1.5'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': {'1.2'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': {'1.8'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': {'1.2'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': {'1.0'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': {'1.0'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': {'1.1'}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': {'1.1'}} Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: consumer versions: Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: { DHCP agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: HyperV agent@hv-cinder-81741: {}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: L3 agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: Metadata agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: Metering agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: Open vSwitch agent@dv-cinder-817417-1-iscsi: { 'ConntrackHelper': '1.0', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': '1.0', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': '1.1', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': '1.5', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': '1.2', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': '1.8', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': '1.2', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': '1.0', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': '1.0', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': '1.1', Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': '1.1'}} Nov 11 11:40:12.871358 dv-cinder-817417-1-iscsi neutron-server[88215]: {{(pid=88330) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Nov 11 11:40:12.881317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.889234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:12.891660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.915537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:12.942067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.947463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:12.962546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-274b3c22-01ed-4bfa-97b0-a7087c85081d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:12.991791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.008535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1016} {{(pid=88329) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:40:13.019290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.019787 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Added segment f738a606-21d7-4c80-9a99-5e69bf9a03d2 of type vlan for network 7c4246da-4773-4e75-9daa-b9c878c13272 Nov 11 11:40:13.021319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Attempting to bind port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:13.021919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Attempting to bind port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:13.022523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Attempting to bind port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e on network 6f90028e-6513-4ec3-884d-7830777c7626 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:13.030773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:13.031531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Checking segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:13.032168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.032801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Bound using segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:13.033497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Bound port: f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:13.034111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.039958 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.9427240 Nov 11 11:40:13.042822 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.043513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57936) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:13.054814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.091878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:13.125153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:13.125782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.137797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.146972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:13.147675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.156273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Request body: {'subnet': {'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-subnet', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:13.167212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:13.169981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Pushing event updated for resources: {'Network': ['ID=d616b076-b5a7-4954-b999-21a3b4c0cf2f,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:13.174579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:13.175023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.012s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:13.192768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network d616b076-b5a7-4954-b999-21a3b4c0cf2f details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:40:13.201887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Usage tracker for resource:subnet and tenant:d45efb8e286d41399941bdf844af2b3c is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:13.207246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:13.220129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] For port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:13.225459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:13.247791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] For port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:13.252645 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 2.1139886 Nov 11 11:40:13.255357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57944) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:13.299555 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.7561157 Nov 11 11:40:13.309635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.311005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Request body: {'subnet': {'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-subnet', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:13.313896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 57948) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:13.319642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:13.321558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4ebddd5-d236-47a2-affc-c5ded3fd45d0,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:13.326966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:13.335794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:13.348512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Usage tracker for resource:subnet and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:13.350526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Request body: {'subnet': {'network_id': '7c4246da-4773-4e75-9daa-b9c878c13272', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-297016562-subnet', 'tenant_id': '494d10266beb49e2a9a6952aeefc82ef', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:13.352453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:13.357124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-728c9146-e873-45b3-b26e-93e5477d4a98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.165s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:13.374288 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:13.454541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Allocated IP 172.27.3.6 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/00c95897-698a-4236-ab83-98868d5cdc26) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:13.457264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Pushing event updated for resources: {'Port': ['ID=f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:13.460851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:13.481898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:13.507708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Usage tracker for resource:subnet and tenant:494d10266beb49e2a9a6952aeefc82ef is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:13.514641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:13.520811 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1db00833-07aa-4309-9e08-f47be707dda0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.522682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Made reservation on behalf of d45efb8e286d41399941bdf844af2b3c for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:13.529275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.614222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.641072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:13.644859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Pushing event updated for resources: {'Network': ['ID=95fd47ac-3c3a-4852-88d6-8eed6cc12159,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:13.648965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.474s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:13.655899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Made reservation on behalf of 49b88e3cf8f748be91f37e0b9caccf6d for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:13.656691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:40:13.661269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Notify callbacks [] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:13.819690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Pushing event updated for resources: {'Network': ['ID=7c4246da-4773-4e75-9daa-b9c878c13272,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:13.825777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.468s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:13.863295 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 7c4246da-4773-4e75-9daa-b9c878c13272 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:40:13.865401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Made reservation on behalf of 494d10266beb49e2a9a6952aeefc82ef for: {'subnet': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:13.871192 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.027442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.326015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.334120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-435f80b6-7504-42ba-abfd-a1950ef113f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:14.440347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c0ace514-c466-40d3-9d56-40ff46839783,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:14.448152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:14.454299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Checking segment: {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:14.455053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Network hostable DHCP agents. Network: d616b076-b5a7-4954-b999-21a3b4c0cf2f, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:40:14.471909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.475333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.487320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:14.494920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:14.585891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:14.590535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:14.596124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Network d616b076-b5a7-4954-b999-21a3b4c0cf2f is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:40:14.596790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:14.625351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Pushing event updated for resources: {'Port': ['ID=00c95897-698a-4236-ab83-98868d5cdc26,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:14.634969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.639617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:14.647228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:14.667819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.687033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Checking segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:14.687655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Network hostable DHCP agents. Network: 95fd47ac-3c3a-4852-88d6-8eed6cc12159, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:40:14.714830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, d616b076-b5a7-4954-b999-21a3b4c0cf2f) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:14.721519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:14.722499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.739331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35f509b6-6091-4ee8-b100-57e92f75edfd None None] Network d616b076-b5a7-4954-b999-21a3b4c0cf2f requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:14.774829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Pushing event updated for resources: {'Subnet': ['ID=438f756e-e154-4e6d-b79f-74ad54d1cabe,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:14.777927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:14.794722 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 1.6822572 Nov 11 11:40:14.802234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57978) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:14.809248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:14.815516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:40:14.829456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:14.830589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6475e617-8ff3-42cb-968f-868863503d26,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:14.832777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 95fd47ac-3c3a-4852-88d6-8eed6cc12159) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:14.838426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:14.840082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:14.850438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:14.852651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f94bbedd-64dc-4ce6-9887-248b97a8605c None None] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:14.863966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Usage tracker for resource:router and tenant:d45efb8e286d41399941bdf844af2b3c is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:14.872810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:14.889475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:14.894287 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.6055479 Nov 11 11:40:14.898630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Checking segment: {'id': 'f738a606-21d7-4c80-9a99-5e69bf9a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1016, 'network_id': '7c4246da-4773-4e75-9daa-b9c878c13272'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:14.899782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 57990) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:14.900268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Network hostable DHCP agents. Network: 7c4246da-4773-4e75-9daa-b9c878c13272, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88329) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:40:14.914027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:14.926200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:14.938334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Usage tracker for resource:router and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:14.950386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:14.959208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:14.996588 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Network 7c4246da-4773-4e75-9daa-b9c878c13272 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88329) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:40:15.030002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.031471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.048425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.049398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.097542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 7c4246da-4773-4e75-9daa-b9c878c13272) {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:15.103758 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:15.104416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.115179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51159607-74f5-4b8e-84e4-44896b8f712a None None] Network 7c4246da-4773-4e75-9daa-b9c878c13272 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:15.155384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.168750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.171117 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.171590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:15.257095 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cd5678f0-8ac6-4de9-87c7-b95ba9818545 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.9307525 Nov 11 11:40:15.706160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52432c33-ddde-4924-8df7-f6ff0a36d09d None None] Network 7c4246da-4773-4e75-9daa-b9c878c13272 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:15.735962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78246575-c18b-45ce-a834-6e9764b1229b None None] Network d616b076-b5a7-4954-b999-21a3b4c0cf2f requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:15.781563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Router bf5e2202-8700-46f0-9f7b-d7820ecb5663 is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88329) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:40:16.147190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:16.158722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:16.305364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:40:16.321218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Sync routers for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:40:16.346411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:16.347495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:16.379715 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Notify callbacks [] for router, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:16.381074 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 4.6542444 Nov 11 11:40:16.384088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58040) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:16.439009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:40:16.443446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:16.604639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:16.681736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e4acca2-dfa3-42d0-bf56-8483eaffce53 None None] Network 6f90028e-6513-4ec3-884d-7830777c7626 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:16.986975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:16.986975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:16.986975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:16.986975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:17.088690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:17.089323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-9cf9a61f-b0f1-4395-9b53-f65f09c025d0 None None] Provisioning for port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:17.209441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58070) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:17.213003 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 11 11:40:17.427534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Allocated IP 172.20.0.2 (95fd47ac-3c3a-4852-88d6-8eed6cc12159/438f756e-e154-4e6d-b79f-74ad54d1cabe/19777011-5a23-4943-933c-9702ae0d11ce) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:17.510160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58082) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:17.513584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Allocated IP 172.27.3.238 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/5eadec18-337a-4eb6-aa8f-d9d1a9f98039) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:17.678048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:14Z', 'revision_number': 3, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:17.683632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Checking router: bf5e2202-8700-46f0-9f7b-d7820ecb5663 for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:40:17.684293 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Updating router bf5e2202-8700-46f0-9f7b-d7820ecb5663 port 00c95897-698a-4236-ab83-98868d5cdc26 binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:40:17.769154 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:17.804353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-13450b28-b947-4f72-b371-d435af749c32 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:17.805313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-13450b28-b947-4f72-b371-d435af749c32 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Synchronizing usage tracker for tenant:494d10266beb49e2a9a6952aeefc82ef on resource:network {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:17.868104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:17.954944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:17.972648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-13450b28-b947-4f72-b371-d435af749c32 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Unset dirty status for tenant:494d10266beb49e2a9a6952aeefc82ef on resource:network {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:17.973303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Usage tracker for resource:security_group_rule and tenant:3deeb8c143884f32bbba788a44ad9666 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:17.976670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:17.983226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:17.988349 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-13450b28-b947-4f72-b371-d435af749c32 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/networks?id=7c4246da-4773-4e75-9daa-b9c878c13272 HTTP/1.1" status: 200 len: 811 time: 0.7779288 Nov 11 11:40:18.060188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.099921 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5ae2bf79-6faf-40ba-b403-4af1a63c281f tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/quotas/494d10266beb49e2a9a6952aeefc82ef HTTP/1.1" status: 200 len: 375 time: 0.1098371 Nov 11 11:40:18.105896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.106916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:18.112632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:18.113127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.115468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:18.159452 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-e1aa1b33-963f-4523-a57e-e0d43d8557b2 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=494d10266beb49e2a9a6952aeefc82ef&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0525792 Nov 11 11:40:18.161298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.164525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.171662 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3deeb8c143884f32bbba788a44ad9666&name=default HTTP/1.1" status: 200 len: 2647 time: 0.6583142 Nov 11 11:40:18.172999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58106) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:18.253172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f477524f-9f74-47d6-8678-bb10694ed7b3,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:18.256068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.258805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:18.281107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Transition to ACTIVE for port object 19777011-5a23-4943-933c-9702ae0d11ce will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:18.347170 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Transition to ACTIVE for port object 19777011-5a23-4943-933c-9702ae0d11ce will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:18.369332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.380297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:18.422657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.460458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Pushing event updated for resources: {'Port': ['ID=5eadec18-337a-4eb6-aa8f-d9d1a9f98039,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:18.467745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:18.474891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:18.495170 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:18.497022 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Allocated IP 172.27.3.206 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/770d481d-69dd-4c7b-9367-a57bafa0c6e9) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:18.500371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:18.510028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:18.576460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:18.582606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-1affd331-1dfc-405d-805e-236135b2ed51 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:40:18.584813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:18.588560 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-1affd331-1dfc-405d-805e-236135b2ed51 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.3241072 Nov 11 11:40:18.593327 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:18.604238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Allocated IP 172.20.0.1 (6f90028e-6513-4ec3-884d-7830777c7626/f175d5dc-0139-4051-bd21-8da204b3ae78/607fbd21-5858-4f98-ac2d-35c35e60c6e7) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:18.719091 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15567e8a-a03d-452e-9e44-5d18d3752f79 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.810897 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.816538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.817456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.839430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Pushing event updated for resources: {'Port': ['ID=19777011-5a23-4943-933c-9702ae0d11ce,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:18.855572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15567e8a-a03d-452e-9e44-5d18d3752f79 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.889084 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.918679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.444s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:18.944027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.946585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:18.963878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Attempting to bind port 19777011-5a23-4943-933c-9702ae0d11ce on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:18.964289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Attempting to bind port 19777011-5a23-4943-933c-9702ae0d11ce by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:18.964693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Attempting to bind port 19777011-5a23-4943-933c-9702ae0d11ce on network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:18.967392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Transition to ACTIVE for port object 607fbd21-5858-4f98-ac2d-35c35e60c6e7 will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:18.990631 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:18.991215 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Checking segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:18.991500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:18.991941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Bound using segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:18.992475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Bound port: 19777011-5a23-4943-933c-9702ae0d11ce, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:18.993041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.052214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.054138 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-20417f33-3a30-46f7-89a8-ec30921d2670 service neutron] 10.222.0.11 "GET /v2.0/networks/7c4246da-4773-4e75-9daa-b9c878c13272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4513419 Nov 11 11:40:19.066376 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-22deb52d-1a5c-456a-9649-d3271fecc937 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:19.126732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] For port 19777011-5a23-4943-933c-9702ae0d11ce, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:19.126732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] For port 19777011-5a23-4943-933c-9702ae0d11ce, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=19777011-5a23-4943-933c-9702ae0d11ce,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:19.126732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.126732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:19.182180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:19.185126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Pushing event updated for resources: {'Port': ['ID=770d481d-69dd-4c7b-9367-a57bafa0c6e9,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:19.188078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:19.200999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:19.235187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:19.263029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:19.267597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.268795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:19.300928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dd017577-d1e2-450e-a0d4-44eb861b5082 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:19.344423 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-48f1d5d3-2d18-4f5b-979d-4729c4b38d33 service neutron] 10.222.0.11 "GET /v2.0/networks/7c4246da-4773-4e75-9daa-b9c878c13272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2895002 Nov 11 11:40:19.347205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.378202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:19.424709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Pushing event updated for resources: {'Port': ['ID=19777011-5a23-4943-933c-9702ae0d11ce,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:19.431313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:19.463627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Network 6f90028e-6513-4ec3-884d-7830777c7626 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:19.467667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:19.467838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.469895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15567e8a-a03d-452e-9e44-5d18d3752f79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.470839 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:19.471481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.496858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Transition to ACTIVE for port object 00c95897-698a-4236-ab83-98868d5cdc26 will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:19.534280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.541026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:19.576647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Pushing event updated for resources: {'Port': ['ID=607fbd21-5858-4f98-ac2d-35c35e60c6e7,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:19.603799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:19.605602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-00a91a03-f207-413c-9ece-a5bd36c3ae48 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.061s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:19.626883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15567e8a-a03d-452e-9e44-5d18d3752f79 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.671607 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-15567e8a-a03d-452e-9e44-5d18d3752f79 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f477524f-9f74-47d6-8678-bb10694ed7b3 HTTP/1.1" status: 204 len: 168 time: 1.4972951 Nov 11 11:40:19.677698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15567e8a-a03d-452e-9e44-5d18d3752f79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f477524f-9f74-47d6-8678-bb10694ed7b3,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:19.684904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-15567e8a-a03d-452e-9e44-5d18d3752f79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:19.817557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-63a53d10-5b5e-4f02-be6e-0b18f72b29ef None None] Provisioning complete for port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:19.817993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-63a53d10-5b5e-4f02-be6e-0b18f72b29ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:19.825463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Router b0d78112-9416-496e-b447-57849419e81d is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88328) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:40:20.016065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Pushing event updated for resources: {'Port': ['ID=00c95897-698a-4236-ab83-98868d5cdc26,revision_number=2']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:20.020440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Attempting to bind port 00c95897-698a-4236-ab83-98868d5cdc26 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:20.021121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Attempting to bind port 00c95897-698a-4236-ab83-98868d5cdc26 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:20.021824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Attempting to bind port 00c95897-698a-4236-ab83-98868d5cdc26 on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:20.035834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.036398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.040341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.041047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.041606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.042635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.043218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.043759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.044313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.044844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Tracked resource versions report: Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: pushed versions: Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: { 'ConntrackHelper': {'1.0'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': {'1.0'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': {'1.1'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': {'1.5'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': {'1.2'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': {'1.8'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': {'1.2'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': {'1.0'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': {'1.0'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': {'1.1'}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': {'1.1'}} Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: consumer versions: Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: { DHCP agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: HyperV agent@hv-cinder-81741: {}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: L3 agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: Metadata agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: Metering agent@dv-cinder-817417-1-iscsi: {}, Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: Open vSwitch agent@dv-cinder-817417-1-iscsi: { 'ConntrackHelper': '1.0', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Log': '1.0', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Network': '1.1', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Port': '1.5', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'PortForwarding': '1.2', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'QosPolicy': '1.8', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroup': '1.2', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SecurityGroupRule': '1.0', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'SubPort': '1.0', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Subnet': '1.1', Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: 'Trunk': '1.1'}} Nov 11 11:40:20.047356 dv-cinder-817417-1-iscsi neutron-server[88215]: {{(pid=88331) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Nov 11 11:40:20.057831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:20.058818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:20.059615 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.060461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:20.061169 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Bound port: 00c95897-698a-4236-ab83-98868d5cdc26, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:20.062399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.095460 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8d6e163b-684e-4930-8d27-3d7426811fd3 req-469b42b2-5100-4ccd-8b64-d9bc9c812373 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 210 time: 0.1933022 Nov 11 11:40:20.102004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.106333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.565s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:20.232958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.235663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.237890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] For port 00c95897-698a-4236-ab83-98868d5cdc26, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:20.243313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] For port 00c95897-698a-4236-ab83-98868d5cdc26, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=00c95897-698a-4236-ab83-98868d5cdc26,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:20.282999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.326587 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6e867230-2ebd-4004-932d-016cd7535c83 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:20.462400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Pushing event updated for resources: {'Port': ['ID=00c95897-698a-4236-ab83-98868d5cdc26,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:20.466576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:20.480334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:20.481039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:20.714411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-defe7ca4-8a16-4ae3-9b03-ac871d8798a7 None None] Provisioning for port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:20.720928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-defe7ca4-8a16-4ae3-9b03-ac871d8798a7 None None] Provisioning complete for port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:20.721355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-defe7ca4-8a16-4ae3-9b03-ac871d8798a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.732110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:40:20.788562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.806863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Sync routers for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:40:20.813895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:20.828115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:20.829141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:20.852271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.853479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.854317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:20.857987 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 5.9474342 Nov 11 11:40:20.860966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58166) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:20.871109 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6d9c5a12-fa0d-41cf-8a39-b9d19bcc742b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:20.972760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58174) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:21.028858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:21.117528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:21.131610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Usage tracker for resource:security_group_rule and tenant:9e7864d571bb4c79acf631c55a2e5a34 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:21.137195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:21.160010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Pushing event updated for resources: {'Port': ['ID=607fbd21-5858-4f98-ac2d-35c35e60c6e7,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:21.171892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:21.220712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88328) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:40:21.223311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:21.297002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.426s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:21.321172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-defe7ca4-8a16-4ae3-9b03-ac871d8798a7 None None] Port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:40:21.412231 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-66c0e2d3-2462-4520-9446-323192d42f64 req-29f0cc57-f6f0-491a-9cc2-d0f68dbd1cb7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 210 time: 0.0984125 Nov 11 11:40:21.474567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Network 6f90028e-6513-4ec3-884d-7830777c7626 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:21.476010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:21.488296 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:21.552353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:18Z', 'revision_number': 1, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:21.565061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c77220-3e33-40a0-8d56-11c82d10b493 None None] The sync data for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi is: [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:18Z', 'revision_number': 1, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:40:21.681072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:21.798666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:21.826856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ebbd973b-c185-4d38-9438-967dcb7b2e57 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:21.967385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:21.968041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:22.018494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:18Z', 'revision_number': 3, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:22.037540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Checking router: b0d78112-9416-496e-b447-57849419e81d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:40:22.038091 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Updating router b0d78112-9416-496e-b447-57849419e81d port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:40:22.063599 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9e7864d571bb4c79acf631c55a2e5a34&name=default HTTP/1.1" status: 200 len: 2647 time: 1.0757196 Nov 11 11:40:22.090847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58198) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:22.189366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1efdfc8a-5be8-4e12-b55a-b50ba60a19c7,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:22.273640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.447s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:22.348597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:22.444774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1165c935-4517-4423-a192-e0a3d0af43d7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:22.478264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1165c935-4517-4423-a192-e0a3d0af43d7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:22.545367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:40:22.555857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-2c0d2948-7c8a-4145-a24c-00e1caca2253 None None] Provisioning complete for port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:22.556837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2c0d2948-7c8a-4145-a24c-00e1caca2253 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:22.559195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Sync routers for ids ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:40:22.588737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Routers {'2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:22.595541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:22.617084 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1165c935-4517-4423-a192-e0a3d0af43d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:22.625085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1165c935-4517-4423-a192-e0a3d0af43d7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:22.625085 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1165c935-4517-4423-a192-e0a3d0af43d7 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1efdfc8a-5be8-4e12-b55a-b50ba60a19c7 HTTP/1.1" status: 204 len: 168 time: 0.5091012 Nov 11 11:40:22.625085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:22.642251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1165c935-4517-4423-a192-e0a3d0af43d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1efdfc8a-5be8-4e12-b55a-b50ba60a19c7,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:22.649585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1165c935-4517-4423-a192-e0a3d0af43d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:22.658405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:22.662370 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 7.8562717 Nov 11 11:40:22.663861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58218) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:22.673411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c809b96-d765-4979-ae96-b6bdd73a15dc None None] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:22.732769 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b076ae31-01ad-4a9d-98fd-9644a954f609 req-97462744-e7cb-4098-b9cc-9a50adac1202 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 210 time: 0.1785140 Nov 11 11:40:22.779558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Router bf5e2202-8700-46f0-9f7b-d7820ecb5663 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:40:23.132064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Set router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:23.226394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:40:23.241748 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] 10.222.0.11 "PUT /v2.0/routers/bf5e2202-8700-46f0-9f7b-d7820ecb5663/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.8565092 Nov 11 11:40:23.451040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 19777011-5a23-4943-933c-9702ae0d11ce up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:23.780765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-2c0d2948-7c8a-4145-a24c-00e1caca2253 None None] Port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:40:23.879570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 19777011-5a23-4943-933c-9702ae0d11ce completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:23.939940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 3, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port': {'id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:d9:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:23.954399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Checking router: 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:40:23.954399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Updating router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a port 770d481d-69dd-4c7b-9367-a57bafa0c6e9 binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:40:24.099189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 00c95897-698a-4236-ab83-98868d5cdc26 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:24.101675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:24.130141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:24.242092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:24.272373 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] Provisioning for port 19777011-5a23-4943-933c-9702ae0d11ce completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:24.279779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58258) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:24.307134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] Provisioning complete for port 19777011-5a23-4943-933c-9702ae0d11ce triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:24.307797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:24.344740 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d71579b-79ea-4704-8893-f6f528e75f78 req-c8642ea4-f9b8-4203-bf2b-7d5520080e66 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 210 time: 0.0599790 Nov 11 11:40:24.358787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Transition to ACTIVE for port object 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:24.610890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.60', 64938) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:24.879981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:25.002310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9fdde856-1aa8-4a0b-acf3-30dfb8466431 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:25.096871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-1bd618b0-b2f3-4877-accc-598bd2e1a4c6 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:25.100233 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-1bd618b0-b2f3-4877-accc-598bd2e1a4c6 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.60 "GET /v2.0/networks?id=7c4246da-4773-4e75-9daa-b9c878c13272 HTTP/1.1" status: 200 len: 811 time: 0.4882321 Nov 11 11:40:25.142304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Request body: {'port': {'device_id': '43d2e685-b837-4758-b0be-7f4308a961e4', 'network_id': '7c4246da-4773-4e75-9daa-b9c878c13272', 'admin_state_up': True, 'tenant_id': '494d10266beb49e2a9a6952aeefc82ef'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:25.181186 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Allocated IP 172.20.0.1 (95fd47ac-3c3a-4852-88d6-8eed6cc12159/438f756e-e154-4e6d-b79f-74ad54d1cabe/b5579f75-6ab0-4891-a00f-12003d90eb5a) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:25.316890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ff6f2a-53b1-4772-bc21-cf18834e64f3 None None] Pushing event updated for resources: {'Port': ['ID=5eadec18-337a-4eb6-aa8f-d9d1a9f98039,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:25.372602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Attempting to bind port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:25.373220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Attempting to bind port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:25.377958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Attempting to bind port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:25.381618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 00c95897-698a-4236-ab83-98868d5cdc26 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:25.438899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58290) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:25.519498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1857495798', 'description': 'tempest-description--1488954811'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:25.540270 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:25.557432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:25.622714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 00c95897-698a-4236-ab83-98868d5cdc26 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:25.631092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:25.644188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:security_group and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:25.652811 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:25.746078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:25.755166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Usage tracker for resource:port and tenant:494d10266beb49e2a9a6952aeefc82ef is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:25.761097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:25.761522 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:25.761987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:25.762701 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:25.765547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:25.766582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:25.766711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Bound port: 5eadec18-337a-4eb6-aa8f-d9d1a9f98039, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:25.767428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:25.793351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:25.845347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f2a-53b1-4772-bc21-cf18834e64f3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.855s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:25.886208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] For port 19777011-5a23-4943-933c-9702ae0d11ce, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=19777011-5a23-4943-933c-9702ae0d11ce,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:25.926419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] For port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:25.963309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Made reservation on behalf of 494d10266beb49e2a9a6952aeefc82ef for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:25.980219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:25.984944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:25.993571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] For port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=5eadec18-337a-4eb6-aa8f-d9d1a9f98039,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:25.996393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:25.998379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.002244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.018611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Transition to ACTIVE for port object 770d481d-69dd-4c7b-9367-a57bafa0c6e9 will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:26.031868 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1fb9d17e-2dc9-402d-a54f-9fefcc53897f req-513164a8-8f26-4668-81ac-83ef5afa45e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 210 time: 0.2100887 Nov 11 11:40:26.102586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.108750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:26.117783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58316) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:26.124931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] Pushing event updated for resources: {'Port': ['ID=19777011-5a23-4943-933c-9702ae0d11ce,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:26.130708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:26.136089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.144602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.164378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:26.286730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df3558d-3104-442e-8fb2-0643df338bb9 None None] Pushing event updated for resources: {'Port': ['ID=770d481d-69dd-4c7b-9367-a57bafa0c6e9,revision_number=2']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:26.299547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Attempting to bind port 770d481d-69dd-4c7b-9367-a57bafa0c6e9 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:26.299547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Attempting to bind port 770d481d-69dd-4c7b-9367-a57bafa0c6e9 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:26.299547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Attempting to bind port 770d481d-69dd-4c7b-9367-a57bafa0c6e9 on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:26.300240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0df3558d-3104-442e-8fb2-0643df338bb9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:26.305962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ff6f2a-53b1-4772-bc21-cf18834e64f3 None None] Pushing event updated for resources: {'Port': ['ID=5eadec18-337a-4eb6-aa8f-d9d1a9f98039,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:26.308669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.311590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:26.312007 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:26.312451 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.312876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:26.313387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Bound port: 770d481d-69dd-4c7b-9367-a57bafa0c6e9, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:26.313800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.318457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f2a-53b1-4772-bc21-cf18834e64f3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:26.321914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:26.336785 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:security_group_rule and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:26.346051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:26.347110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:26.349771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:26.365891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:26.410773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-05437725-9888-4ee1-a89d-66af3db5879e None None] Provisioning complete for port 19777011-5a23-4943-933c-9702ae0d11ce triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:26.411263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05437725-9888-4ee1-a89d-66af3db5879e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.461603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Transition to ACTIVE for port object b5579f75-6ab0-4891-a00f-12003d90eb5a will not be triggered until provisioned by entity DHCP. {{(pid=88328) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:26.496117 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 00c95897-698a-4236-ab83-98868d5cdc26, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=00c95897-698a-4236-ab83-98868d5cdc26,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:26.511042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] For port 770d481d-69dd-4c7b-9367-a57bafa0c6e9, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:26.515819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] For port 770d481d-69dd-4c7b-9367-a57bafa0c6e9, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=770d481d-69dd-4c7b-9367-a57bafa0c6e9,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:26.534374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Allocated IP 172.20.0.4 (7c4246da-4773-4e75-9daa-b9c878c13272/6475e617-8ff3-42cb-968f-868863503d26/d406b7f5-8b66-41f4-b933-ed75fdf4d06e) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:26.591987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.613883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:26.640522 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.645932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:26.651162 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.697269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f2a-53b1-4772-bc21-cf18834e64f3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:26.819598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df3558d-3104-442e-8fb2-0643df338bb9 None None] Pushing event updated for resources: {'Port': ['ID=770d481d-69dd-4c7b-9367-a57bafa0c6e9,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:26.824995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0df3558d-3104-442e-8fb2-0643df338bb9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:26.826346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Routers {'2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:26.827429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:26.834286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 19777011-5a23-4943-933c-9702ae0d11ce up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:26.853703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:26.874405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:26.887552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:26.906269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:26.906794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.008847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.051778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:27.066944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.086292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:27.101502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 19777011-5a23-4943-933c-9702ae0d11ce triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:27.102048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.131350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=00c95897-698a-4236-ab83-98868d5cdc26,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:27.136050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.142954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Pushing event updated for resources: {'Port': ['ID=b5579f75-6ab0-4891-a00f-12003d90eb5a,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:27.158211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.465s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:27.158407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.544s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:27.164052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:27.321967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Network 7c4246da-4773-4e75-9daa-b9c878c13272 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:27.337158 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:27.350093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:27.387344 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:27.388911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.443332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] Set router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:27.461261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Usage tracker for resource:security_group_rule and tenant:15f2f9de286b43a38bcc465d1d816dcd is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:27.465544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.475801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.496578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:27.596384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Pushing event updated for resources: {'Port': ['ID=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:27.601718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.516s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:27.687309 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5513272 Nov 11 11:40:27.709790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082b5161-a1b5-4b36-91e3-dd4c2807f0b5 req-58e8a9a2-1ca6-4714-a444-ef6ce2c9daa7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:27.711041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-082b5161-a1b5-4b36-91e3-dd4c2807f0b5 req-58e8a9a2-1ca6-4714-a444-ef6ce2c9daa7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Synchronizing usage tracker for tenant:494d10266beb49e2a9a6952aeefc82ef on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:27.795445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Sync routers for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:40:27.806940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6078adf5-804c-400b-ae6b-8845e346854c None None] Provisioning for port b5579f75-6ab0-4891-a00f-12003d90eb5a completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:27.807133 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-082b5161-a1b5-4b36-91e3-dd4c2807f0b5 req-58e8a9a2-1ca6-4714-a444-ef6ce2c9daa7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Unset dirty status for tenant:494d10266beb49e2a9a6952aeefc82ef on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:27.808469 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-082b5161-a1b5-4b36-91e3-dd4c2807f0b5 req-58e8a9a2-1ca6-4714-a444-ef6ce2c9daa7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 931 time: 0.3910573 Nov 11 11:40:27.864744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.867258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.880745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:27.908443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6078adf5-804c-400b-ae6b-8845e346854c None None] Provisioning complete for port b5579f75-6ab0-4891-a00f-12003d90eb5a triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:27.908978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6078adf5-804c-400b-ae6b-8845e346854c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.958222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:27.970481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-082b5161-a1b5-4b36-91e3-dd4c2807f0b5 req-330ac404-ebd2-4dca-808f-df2d443fe6db tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Synchronizing usage tracker for tenant:494d10266beb49e2a9a6952aeefc82ef on resource:security_group {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:27.974003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:27.982573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:27.984069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:28.000147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:28.065378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-082b5161-a1b5-4b36-91e3-dd4c2807f0b5 req-330ac404-ebd2-4dca-808f-df2d443fe6db tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Unset dirty status for tenant:494d10266beb49e2a9a6952aeefc82ef on resource:security_group {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:28.067461 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-082b5161-a1b5-4b36-91e3-dd4c2807f0b5 req-330ac404-ebd2-4dca-808f-df2d443fe6db tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2512112 Nov 11 11:40:28.072812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:28.075534 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1614 time: 2.5645323 Nov 11 11:40:28.078886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58364) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:28.087790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'security_group_rule': {'security_group_id': '4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:28.107565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:28.139950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:security_group_rule and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:28.140641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 3, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port': {'id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:d9:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:28.144924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:28.146372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12557a73-af9b-4782-811e-8e1c79806280 None None] The sync data for ids ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'] in dv-cinder-817417-1-iscsi is: [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 3, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port': {'id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:d9:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:40:28.164893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:28.235591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-6078adf5-804c-400b-ae6b-8845e346854c None None] Port b5579f75-6ab0-4891-a00f-12003d90eb5a cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:40:28.238353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:28.440495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:28.461481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.503s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:28.536540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:28.574403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.533s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:28.599945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:28.602510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:28.622832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:28.651930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=10af32bb-85f1-4510-87c1-f9ae37bdf0a6,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:28.659047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:28.691350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:18Z', 'revision_number': 3, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:28.699277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f298855f-b534-42f1-92d1-2ffec46602d3 None None] The sync data for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi is: [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:18Z', 'revision_number': 3, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:40:28.704862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:28.706293 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.6251383 Nov 11 11:40:28.709272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58376) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:28.716827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'security_group_rule': {'security_group_id': '4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:28.728134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:28.737109 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:security_group_rule and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:28.740837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:28.760733 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:28.842674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:28.872819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-45f3f339-1e5f-4743-8075-b0827606458b tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:40:28.874583 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-45f3f339-1e5f-4743-8075-b0827606458b tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.60 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.0063438 Nov 11 11:40:28.883134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 00c95897-698a-4236-ab83-98868d5cdc26 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:29.039555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:29.075114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Pushing event updated for resources: {'Port': ['ID=b5579f75-6ab0-4891-a00f-12003d90eb5a,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:29.097590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:29.131257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:29.141309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.567s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:29.184805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:29.187816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-002f743f-c741-4afe-801d-66ac924bacc6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:29.222610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5fd033c0-8cd6-4df4-8096-6356d45c33f2,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:29.230410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:29.247952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:29.282930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:29.316088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 00c95897-698a-4236-ab83-98868d5cdc26 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:29.316698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:29.405387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:29.406979 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.6966588 Nov 11 11:40:29.422194 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58390) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:29.432017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:29.443980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:29.489166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:floatingip and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:29.493519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:29.506277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:29.540669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:29.573381 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=15f2f9de286b43a38bcc465d1d816dcd&name=default HTTP/1.1" status: 200 len: 2647 time: 3.4320900 Nov 11 11:40:29.580392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58394) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:29.620065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:29.736372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0be01c7-fe9b-4c77-a840-7fb13d2b7411,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:29.745207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:29.756847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:20Z', 'revision_number': 2, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:29.769342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Checking router: bf5e2202-8700-46f0-9f7b-d7820ecb5663 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:40:29.769590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9ae1fbd-b4ba-44ab-8d4c-5e075d56b0fc req-581d780c-368a-494e-88a8-11f45776c861 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:29.770186 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Updating router bf5e2202-8700-46f0-9f7b-d7820ecb5663 port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:40:29.777362 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f9ae1fbd-b4ba-44ab-8d4c-5e075d56b0fc req-581d780c-368a-494e-88a8-11f45776c861 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 931 time: 0.4501131 Nov 11 11:40:29.854718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:29.928905 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Allocated IP 172.20.0.1 (d616b076-b5a7-4954-b999-21a3b4c0cf2f/c0ace514-c466-40d3-9d56-40ff46839783/22d627d7-6ff0-48cd-b93e-559401603c6a) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:29.966384 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f9ae1fbd-b4ba-44ab-8d4c-5e075d56b0fc req-9808ded6-14ab-4295-9814-6bdbfb3386c6 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1876800 Nov 11 11:40:29.967743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41965c7c-c38d-42b2-909a-0263ae178f8b None None] Provisioning complete for port b5579f75-6ab0-4891-a00f-12003d90eb5a triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:29.968182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41965c7c-c38d-42b2-909a-0263ae178f8b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.121894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.131028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41965c7c-c38d-42b2-909a-0263ae178f8b None None] Port b5579f75-6ab0-4891-a00f-12003d90eb5a cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:40:30.222425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f0f32e67-7d0b-45a7-a02b-9374a4169582 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.396920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f0f32e67-7d0b-45a7-a02b-9374a4169582 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.499553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Allocated IP 172.27.3.26 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/1c84c43a-879d-4da9-9c2d-93b42720b1c8) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:30.533657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.621659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.646653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:30.798294 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Network d616b076-b5a7-4954-b999-21a3b4c0cf2f is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:30.803380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:30.816191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f0f32e67-7d0b-45a7-a02b-9374a4169582 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.821290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:30.821813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.824118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.856671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.858826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Pushing event updated for resources: {'Port': ['ID=22d627d7-6ff0-48cd-b93e-559401603c6a,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:30.864079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:30.867045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-47f670e8-2ed3-4b5f-b4aa-329cfe026e99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.009s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:30.881526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Transition to ACTIVE for port object 607fbd21-5858-4f98-ac2d-35c35e60c6e7 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:30.882382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Router b0d78112-9416-496e-b447-57849419e81d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:40:30.922616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 770d481d-69dd-4c7b-9367-a57bafa0c6e9 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:30.923525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.924564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f32e67-7d0b-45a7-a02b-9374a4169582 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0be01c7-fe9b-4c77-a840-7fb13d2b7411,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:30.935300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f0f32e67-7d0b-45a7-a02b-9374a4169582 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:30.946103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:30.956972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f0f32e67-7d0b-45a7-a02b-9374a4169582 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:30.958840 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-f0f32e67-7d0b-45a7-a02b-9374a4169582 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e0be01c7-fe9b-4c77-a840-7fb13d2b7411 HTTP/1.1" status: 204 len: 168 time: 1.3689134 Nov 11 11:40:30.978161 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:31.000148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:31.050129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:31.053549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:31.064783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:31.308439 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:31.444619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f06f218-ede7-46c8-98e1-075ae40f83c1 None None] Pushing event updated for resources: {'Port': ['ID=607fbd21-5858-4f98-ac2d-35c35e60c6e7,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:31.445249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 770d481d-69dd-4c7b-9367-a57bafa0c6e9 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:31.456388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3f06f218-ede7-46c8-98e1-075ae40f83c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.456s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:31.474419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 770d481d-69dd-4c7b-9367-a57bafa0c6e9 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:31.474861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:31.863331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Attempting to bind port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:31.863878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Attempting to bind port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:31.864146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Attempting to bind port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 on network 6f90028e-6513-4ec3-884d-7830777c7626 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:31.986806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:32.001701 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Checking segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:32.002407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.002852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Bound using segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:32.003462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Bound port: 607fbd21-5858-4f98-ac2d-35c35e60c6e7, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:32.003903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.087187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.118249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'Port': ['ID=1c84c43a-879d-4da9-9c2d-93b42720b1c8,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:32.128368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.182s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:32.183466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.277015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] For port 607fbd21-5858-4f98-ac2d-35c35e60c6e7, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:32.283266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] For port 607fbd21-5858-4f98-ac2d-35c35e60c6e7, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=607fbd21-5858-4f98-ac2d-35c35e60c6e7,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:32.288130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de2e92e9-f58f-4799-bebf-911c10489a50 req-acd1b5d3-9e00-4c65-b1f9-f3a5d035803a tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:32.293152 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-de2e92e9-f58f-4799-bebf-911c10489a50 req-acd1b5d3-9e00-4c65-b1f9-f3a5d035803a tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 931 time: 0.8816152 Nov 11 11:40:32.311598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.333225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 770d481d-69dd-4c7b-9367-a57bafa0c6e9, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=770d481d-69dd-4c7b-9367-a57bafa0c6e9,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:32.334367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:32.372752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.393513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.403942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.405409 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:32.446267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.449074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:32.455988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:32.478705 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-de2e92e9-f58f-4799-bebf-911c10489a50 req-6ba1fa91-ff42-40dd-8976-e3d2ed1ace11 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1760228 Nov 11 11:40:32.655713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f06f218-ede7-46c8-98e1-075ae40f83c1 None None] Pushing event updated for resources: {'Port': ['ID=607fbd21-5858-4f98-ac2d-35c35e60c6e7,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:32.680508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3f06f218-ede7-46c8-98e1-075ae40f83c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.346s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:32.681632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4227db06-0919-47ff-bc28-48a2abfc5dae None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.238s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:32.808067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:40:32.819866 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] 10.222.0.11 "PUT /v2.0/routers/b0d78112-9416-496e-b447-57849419e81d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.9558597 Nov 11 11:40:32.821163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Pushing event updated for resources: {'Port': ['ID=22d627d7-6ff0-48cd-b93e-559401603c6a,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:32.841761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.386s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:32.849222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:32.850185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:33.101626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:33.162998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:33.199653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:33.242084 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:33.268544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=770d481d-69dd-4c7b-9367-a57bafa0c6e9,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:33.309265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Network d616b076-b5a7-4954-b999-21a3b4c0cf2f is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:33.310583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:33.367181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'Port': ['ID=1c84c43a-879d-4da9-9c2d-93b42720b1c8,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:33.396136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:33.446804 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.764s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:33.454548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:33.455263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:33.472003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:33.509929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:33.509929 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.0750999 Nov 11 11:40:33.779357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58486) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:33.839193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:34.044810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.176168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-462249003-network', 'tenant_id': '55ff6abc743549b69ad556ecbc404728'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:34.187651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d523584-464f-4060-8bbf-2acc3a15d313 req-ea4bf22e-3a4c-47f2-9e1b-97f3840c40d2 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:34.189555 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2d523584-464f-4060-8bbf-2acc3a15d313 req-ea4bf22e-3a4c-47f2-9e1b-97f3840c40d2 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 931 time: 0.2594800 Nov 11 11:40:34.190655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:34.190947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=5eadec18-337a-4eb6-aa8f-d9d1a9f98039,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:34.200212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Usage tracker for resource:network and tenant:55ff6abc743549b69ad556ecbc404728 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:34.206007 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:34.272729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.276152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:34.299274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:34.316837 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2d523584-464f-4060-8bbf-2acc3a15d313 req-e148dd3b-9a57-4a8f-a335-de062126dae3 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1128123 Nov 11 11:40:34.326432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:40:34.350801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Made reservation on behalf of 55ff6abc743549b69ad556ecbc404728 for: {'network': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:34.356078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.392364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.410235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58498) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:34.433668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1661240300', 'description': 'tempest-description--1941471471'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:34.453518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:34.457657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:security_group and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:34.466722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:34.481649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:34.525145 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:34.541696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Usage tracker for resource:security_group_rule and tenant:55ff6abc743549b69ad556ecbc404728 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:34.546551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.546958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:34.547491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 770d481d-69dd-4c7b-9367-a57bafa0c6e9 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:34.550873 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.567440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:34.645734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=5eadec18-337a-4eb6-aa8f-d9d1a9f98039,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:34.649905 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.356s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:34.652864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:34.669623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:security_group_rule and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:34.681439 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:34.684234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:32Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:34.689972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-111e7616-69ec-4038-878a-4fbaa6ac0e39 None None] The sync data for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi is: [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:32Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:40:34.708541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:34.713580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 770d481d-69dd-4c7b-9367-a57bafa0c6e9 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:34.714242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.830585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.833538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-04b98984-7b1a-479f-9682-72c89fc204e5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Synchronizing usage tracker for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:security_group {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:34.882041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:34.918363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:34.953096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 607fbd21-5858-4f98-ac2d-35c35e60c6e7 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:34.955984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:40:34.966914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Sync routers for ids ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:40:34.974208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63a94d11-699c-4635-8c8b-a7b597d6251f,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:34.986331 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] 10.222.0.11 "PUT /v2.0/routers/2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.1626217 Nov 11 11:40:34.986526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-04b98984-7b1a-479f-9682-72c89fc204e5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Unset dirty status for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:security_group {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:34.986526 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-04b98984-7b1a-479f-9682-72c89fc204e5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1857495798&fields=id&tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be HTTP/1.1" status: 200 len: 267 time: 0.3473532 Nov 11 11:40:35.010818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:35.030299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Routers {'2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:35.030299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:35.173454 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:35.194274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:35.196262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.310525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-97db2ee5-d01b-4f08-b3ca-2606907b1a00 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:35.311673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-97db2ee5-d01b-4f08-b3ca-2606907b1a00 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Synchronizing usage tracker for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:network {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:35.319202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.320362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1024} {{(pid=88329) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:40:35.327658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Set router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:35.378547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.379590 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Added segment 7151ed62-7d8b-480f-90e2-d18f75511f30 of type vlan for network 4e704c47-c75b-464c-aaf5-fc9a9e2ba59c Nov 11 11:40:35.403276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.425863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.429965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:35.453063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-97db2ee5-d01b-4f08-b3ca-2606907b1a00 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Unset dirty status for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:network {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:35.461558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Sync routers for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:40:35.465249 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-97db2ee5-d01b-4f08-b3ca-2606907b1a00 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 811 time: 0.4628251 Nov 11 11:40:35.500376 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:35.500376 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:35.507581 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-5410c9c5-88a8-47f5-9bb2-c49a079c3c21 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/quotas/307ee8e0c17a4e1ebce8db1a0c8ca6be HTTP/1.1" status: 200 len: 375 time: 0.0249515 Nov 11 11:40:35.622840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.654156 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9c29ba10-7781-4132-85a5-1106bd95cd6b,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:35.668813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:35.707273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-0fe81aad-f3c5-4290-ac78-31724d6cc9b9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Synchronizing usage tracker for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:35.728684 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.733753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58542) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:35.740356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'security_group_rule': {'security_group_id': '9c29ba10-7781-4132-85a5-1106bd95cd6b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:35.740536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 607fbd21-5858-4f98-ac2d-35c35e60c6e7, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=607fbd21-5858-4f98-ac2d-35c35e60c6e7,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:35.746182 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1614 time: 1.3347449 Nov 11 11:40:35.751374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:35.770422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.782972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:security_group_rule and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:35.786199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:35.799169 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:35.801539 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:35.820131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:35.820772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.831849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:35.847519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-0fe81aad-f3c5-4290-ac78-31724d6cc9b9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Unset dirty status for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:35.849103 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-0fe81aad-f3c5-4290-ac78-31724d6cc9b9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3064790 Nov 11 11:40:35.856311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.863123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.872517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:35.896648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:30Z', 'revision_number': 4, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port': {'id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:d9:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '22d627d7-6ff0-48cd-b93e-559401603c6a', 'name': '', 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'mac_address': 'fa:16:3e:15:7b:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'c0ace514-c466-40d3-9d56-40ff46839783', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:28Z', 'updated_at': '2021-11-11T11:40:31Z', 'revision_number': 2, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'subnets': [{'id': 'c0ace514-c466-40d3-9d56-40ff46839783', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:35.901903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Checking router: 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:40:35.902298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Updating router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a port 22d627d7-6ff0-48cd-b93e-559401603c6a binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:40:35.973185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:35.984438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.025182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.027491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:36.053273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c70377a7-507d-45b7-a46c-1da7e3029d4f,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:36.087242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=607fbd21-5858-4f98-ac2d-35c35e60c6e7,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:36.091861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:36.116568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:36.143370 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 2.3623340 Nov 11 11:40:36.146325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58550) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:36.154665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Request body: {'subnet': {'network_id': '4e704c47-c75b-464c-aaf5-fc9a9e2ba59c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-462249003-subnet', 'tenant_id': '55ff6abc743549b69ad556ecbc404728', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:36.169137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:36.181997 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.193747 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.4537680 Nov 11 11:40:36.194505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58556) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:36.195876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Usage tracker for resource:subnet and tenant:55ff6abc743549b69ad556ecbc404728 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:36.207007 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:36.218148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'security_group_rule': {'security_group_id': '9c29ba10-7781-4132-85a5-1106bd95cd6b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:36.236417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:36.244221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:36.255227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:security_group_rule and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:36.268813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:36.286983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:36.307466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Pushing event updated for resources: {'Network': ['ID=4e704c47-c75b-464c-aaf5-fc9a9e2ba59c,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:36.317097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Made reservation on behalf of 55ff6abc743549b69ad556ecbc404728 for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:36.322065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.338680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.507s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:36.355494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 4e704c47-c75b-464c-aaf5-fc9a9e2ba59c details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:40:36.388504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e27f7a-fd18-4308-b573-83741698ac6e req-83269cb1-e655-4e57-99e1-9a70ba3f78be tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:36.403883 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-83269cb1-e655-4e57-99e1-9a70ba3f78be tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 819 time: 0.6369724 Nov 11 11:40:36.481019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.484181 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-825f503c-30dd-41a3-9c4d-4b0d107af7c3 service neutron] 10.222.0.11 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5762293 Nov 11 11:40:36.505718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 607fbd21-5858-4f98-ac2d-35c35e60c6e7 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:36.672619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.684511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:36.684932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.708190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.727136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Transition to ACTIVE for port object 22d627d7-6ff0-48cd-b93e-559401603c6a will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:36.728682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.734590 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-8b23bf07-c8f8-4d0c-90cf-d770191fff72 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/quotas/d45efb8e286d41399941bdf844af2b3c HTTP/1.1" status: 200 len: 375 time: 0.3280299 Nov 11 11:40:36.744842 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:36.750444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:27Z', 'revision_number': 2, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:36.768212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.774592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Checking router: b0d78112-9416-496e-b447-57849419e81d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:40:36.774779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Updating router b0d78112-9416-496e-b447-57849419e81d port b5579f75-6ab0-4891-a00f-12003d90eb5a binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:40:36.783764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e9d75dd-36a1-422b-ae83-82aa067e9b19,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:36.786619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:36.799307 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0df3558d-3104-442e-8fb2-0643df338bb9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:36.850635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.861830 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.6578369 Nov 11 11:40:36.867898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58562) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:36.902152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:36.912087 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-f5f2749e-2d92-4c5b-9b1f-3160c2a4aec2 service neutron] 10.222.0.11 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4268718 Nov 11 11:40:36.933901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:36.939616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.940809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1eab91-b674-48fb-9e67-6ff188552cf5 None None] Pushing event updated for resources: {'Port': ['ID=22d627d7-6ff0-48cd-b93e-559401603c6a,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:36.952526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:floatingip and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:36.968443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:36.976642 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-77b366a9-f209-469b-9ea1-a39506dd7c01 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2410021 Nov 11 11:40:36.983273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:36.987354 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:36.996630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:37.049894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:37.117944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8fce330a-b038-4231-8ebd-de7633ef0eac,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:37.127971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:37.155255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Checking segment: {'id': '7151ed62-7d8b-480f-90e2-d18f75511f30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': '4e704c47-c75b-464c-aaf5-fc9a9e2ba59c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:37.155648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Network hostable DHCP agents. Network: 4e704c47-c75b-464c-aaf5-fc9a9e2ba59c, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:40:37.223493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c1eab91-b674-48fb-9e67-6ff188552cf5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.424s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:37.250859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-f73eb3cc-8fd2-4fec-bca4-25ba67deb4cb service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:40:37.259023 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-f73eb3cc-8fd2-4fec-bca4-25ba67deb4cb service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.1746411 Nov 11 11:40:37.412004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Network 4e704c47-c75b-464c-aaf5-fc9a9e2ba59c is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:40:37.424476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Attempting to bind port 22d627d7-6ff0-48cd-b93e-559401603c6a on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:37.430594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Attempting to bind port 22d627d7-6ff0-48cd-b93e-559401603c6a by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:37.430996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Attempting to bind port 22d627d7-6ff0-48cd-b93e-559401603c6a on network d616b076-b5a7-4954-b999-21a3b4c0cf2f {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:37.448266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:37.455617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Checking segment: {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:37.455617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:37.455617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Bound using segment: {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:37.455617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Bound port: 22d627d7-6ff0-48cd-b93e-559401603c6a, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:37.455617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:37.489987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 4e704c47-c75b-464c-aaf5-fc9a9e2ba59c) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:37.496593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:37.497313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:37.510809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca7c42af-cd5d-4b36-823e-939606ec9ad2 None None] Network 4e704c47-c75b-464c-aaf5-fc9a9e2ba59c requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:37.598409 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:37.623641 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.4752872 Nov 11 11:40:37.683433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:37.748899 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-6317619f-6044-4cd1-a962-c2a2e3ad9894 service neutron] 10.222.0.11 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4882364 Nov 11 11:40:37.842245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] For port 22d627d7-6ff0-48cd-b93e-559401603c6a, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:37.846800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] For port 22d627d7-6ff0-48cd-b93e-559401603c6a, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=22d627d7-6ff0-48cd-b93e-559401603c6a,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:37.920537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:37.926217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:38.128891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Allocated IP 172.27.3.92 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/c52ef870-29d3-4377-bc18-f2e462a7614d) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:38.158032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1eab91-b674-48fb-9e67-6ff188552cf5 None None] Pushing event updated for resources: {'Port': ['ID=22d627d7-6ff0-48cd-b93e-559401603c6a,revision_number=4']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:38.163679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c1eab91-b674-48fb-9e67-6ff188552cf5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:38.176335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Routers {'2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:38.184322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:38.500027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-856ed4ee-10d3-4a82-9694-34e496a75bd7 service neutron] 10.222.0.11 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7501180 Nov 11 11:40:38.540772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd4a18c-b6f4-4a49-bc68-cb133f443d8d req-35041edd-ff52-43f0-aa5d-8568664186ce tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:38.546567 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0bd4a18c-b6f4-4a49-bc68-cb133f443d8d req-35041edd-ff52-43f0-aa5d-8568664186ce tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 931 time: 0.7280884 Nov 11 11:40:38.758733 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:38.785626 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0bd4a18c-b6f4-4a49-bc68-cb133f443d8d req-18aedd9e-f18f-4fb6-9964-dabe8fb04658 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2305713 Nov 11 11:40:38.844222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] Set router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:38.892328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:38.900104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:38.955595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:38.956061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:38.972795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58640) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:39.033079 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8f708e9f-ce40-4d9b-97f8-8ee905164d2f req-3ef4c4cd-f408-4191-8e3e-7b401db14d8b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 210 time: 0.1347928 Nov 11 11:40:39.149173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Request body: {'port': {'device_id': '43d2e685-b837-4758-b0be-7f4308a961e4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:39.179346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'Port': ['ID=c52ef870-29d3-4377-bc18-f2e462a7614d,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:39.195678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:39.244615 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:39.246533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:39.253649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:39.354507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6a45def-7e11-4d87-9110-6934b59ace7d None None] Network 4e704c47-c75b-464c-aaf5-fc9a9e2ba59c requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:39.391502 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3d48123b-4aaa-43ee-88ca-eb69f13df3fb req-a73d8edb-4fbc-48d3-ac42-b16bee3e080e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 210 time: 0.1476896 Nov 11 11:40:39.533193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:39.638157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:39.870799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:39.953574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:39.979082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Usage tracker for resource:security_group_rule and tenant:a5ef9778bd12414dbe07f947f19f6e17 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:39.983084 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:40.000832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:40.340092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Transition to ACTIVE for port object b5579f75-6ab0-4891-a00f-12003d90eb5a will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:40.394151 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0f4633e5-7d85-4e75-9b3a-2c3dbcc791fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:40.433598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:40.442619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:40.526227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:30Z', 'revision_number': 4, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port': {'id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:d9:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '22d627d7-6ff0-48cd-b93e-559401603c6a', 'name': '', 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'mac_address': 'fa:16:3e:15:7b:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'c0ace514-c466-40d3-9d56-40ff46839783', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:28Z', 'updated_at': '2021-11-11T11:40:37Z', 'revision_number': 4, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'subnets': [{'id': 'c0ace514-c466-40d3-9d56-40ff46839783', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:40.578153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:40:40.615791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40f1f117-9b08-4d15-910e-8e3f6141aba7 None None] The sync data for ids ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'] in dv-cinder-817417-1-iscsi is: [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:30Z', 'revision_number': 4, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port': {'id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:d9:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '22d627d7-6ff0-48cd-b93e-559401603c6a', 'name': '', 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'mac_address': 'fa:16:3e:15:7b:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'c0ace514-c466-40d3-9d56-40ff46839783', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:28Z', 'updated_at': '2021-11-11T11:40:37Z', 'revision_number': 4, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'subnets': [{'id': 'c0ace514-c466-40d3-9d56-40ff46839783', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:40:40.813740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.073991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58712) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:41.105308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.105924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7060485c-e078-483e-bbca-e5a71a13a072 None None] Pushing event updated for resources: {'Port': ['ID=b5579f75-6ab0-4891-a00f-12003d90eb5a,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:41.136763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7060485c-e078-483e-bbca-e5a71a13a072 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.680s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:41.212817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-160572544-network', 'tenant_id': '34287fb3f486470ab12524f947235f8c'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:41.236794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d406b7f5-8b66-41f4-b933-ed75fdf4d06e {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:40:41.247425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.275011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:41.276094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Attempting to bind port b5579f75-6ab0-4891-a00f-12003d90eb5a on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:41.279184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Attempting to bind port b5579f75-6ab0-4891-a00f-12003d90eb5a by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:41.280418 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Attempting to bind port b5579f75-6ab0-4891-a00f-12003d90eb5a on network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:41.297202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Usage tracker for resource:network and tenant:34287fb3f486470ab12524f947235f8c is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:41.309518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:41.322789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:41.327425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Checking segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:41.327425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.327425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Bound using segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:41.327425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Bound port: b5579f75-6ab0-4891-a00f-12003d90eb5a, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:41.327425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.375511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:41.514586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Transition to ACTIVE for port object d406b7f5-8b66-41f4-b933-ed75fdf4d06e will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:41.571017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Made reservation on behalf of 34287fb3f486470ab12524f947235f8c for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:41.576608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.621041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.639971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.645080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.692856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5c294ae7-eedf-45db-afc1-c6b6f196b13d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:41.782937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] For port b5579f75-6ab0-4891-a00f-12003d90eb5a, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:41.793661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] For port b5579f75-6ab0-4891-a00f-12003d90eb5a, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=b5579f75-6ab0-4891-a00f-12003d90eb5a,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:41.796628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3df5ea20-a86c-4e22-9fcf-047cd47e76be tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:41.804989 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3df5ea20-a86c-4e22-9fcf-047cd47e76be tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 819 time: 1.6364517 Nov 11 11:40:41.815428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Pushing event updated for resources: {'Port': ['ID=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:41.833714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:41.836739 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:41.839334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:41.842737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:41.848416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2574d314-09b3-4014-ac54-37ee75051598 req-1b9a1c50-c01b-42be-9e16-3357d861efe7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:41.849838 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2574d314-09b3-4014-ac54-37ee75051598 req-1b9a1c50-c01b-42be-9e16-3357d861efe7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 931 time: 0.5730062 Nov 11 11:40:41.863001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Usage tracker for resource:security_group_rule and tenant:34287fb3f486470ab12524f947235f8c is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:41.863816 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-1e051504-1dc6-4cd9-abb7-5adbf51a2f45 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/quotas/d45efb8e286d41399941bdf844af2b3c HTTP/1.1" status: 200 len: 375 time: 0.0577555 Nov 11 11:40:41.919075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:41.936816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:42.095806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:40:42.097063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:40:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:42.363675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 22d627d7-6ff0-48cd-b93e-559401603c6a up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:42.387741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Attempting to bind port d406b7f5-8b66-41f4-b933-ed75fdf4d06e on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:42.388107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Attempting to bind port d406b7f5-8b66-41f4-b933-ed75fdf4d06e by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': 'f738a606-21d7-4c80-9a99-5e69bf9a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1016, 'network_id': '7c4246da-4773-4e75-9daa-b9c878c13272'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:42.388500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Attempting to bind port d406b7f5-8b66-41f4-b933-ed75fdf4d06e on network 7c4246da-4773-4e75-9daa-b9c878c13272 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:42.392639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.430067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.442953 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2574d314-09b3-4014-ac54-37ee75051598 req-a9c65a17-6dfe-41f2-b425-96178da9d040 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4420102 Nov 11 11:40:42.446436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7060485c-e078-483e-bbca-e5a71a13a072 None None] Pushing event updated for resources: {'Port': ['ID=b5579f75-6ab0-4891-a00f-12003d90eb5a,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:42.472363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7060485c-e078-483e-bbca-e5a71a13a072 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.617s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:42.473380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Port d406b7f5-8b66-41f4-b933-ed75fdf4d06e on network 7c4246da-4773-4e75-9daa-b9c878c13272 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:40:42.473680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Attempting to bind port d406b7f5-8b66-41f4-b933-ed75fdf4d06e on network 7c4246da-4773-4e75-9daa-b9c878c13272 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:42.494722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.509090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.511394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.532705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6aef1fe4-42a9-4e94-8fe2-221a9caeb2b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:42.559562 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-90d67e33-688e-48e1-b582-95f1235f53aa tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&fields=id HTTP/1.1" status: 200 len: 255 time: 0.6897795 Nov 11 11:40:42.571198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:42.641491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.668072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:42.668591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Checking segment: {'id': 'f738a606-21d7-4c80-9a99-5e69bf9a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1016, 'network_id': '7c4246da-4773-4e75-9daa-b9c878c13272'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:42.669292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Bound using segment: {'id': 'f738a606-21d7-4c80-9a99-5e69bf9a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1016, 'network_id': '7c4246da-4773-4e75-9daa-b9c878c13272'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:42.670481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Bound port: d406b7f5-8b66-41f4-b933-ed75fdf4d06e, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f738a606-21d7-4c80-9a99-5e69bf9a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1016, 'network_id': '7c4246da-4773-4e75-9daa-b9c878c13272'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:42.675689 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.703394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.745971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=895869dc-d045-49b1-abf4-c15b99dc21e0,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:42.789141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:40:42.797065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'Port': ['ID=c52ef870-29d3-4377-bc18-f2e462a7614d,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:42.799826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:42.805188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1003} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:40:42.809295 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Synchronizing usage tracker for tenant:a02628e0c7ca4087b444fea3b13a9a5e on resource:security_group {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:42.815196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.283s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:42.816624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.126s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:42.887449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.888088 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Added segment 9a4ab315-c754-46d6-b190-2a906fd4a397 of type vlan for network ea935c94-6f15-4c33-ac01-d007674fddf3 Nov 11 11:40:42.909012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b9397db-b283-4db2-a880-ebf154214111,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:42.912442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:42.915929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:42.917413 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 6.0457008 Nov 11 11:40:42.945245 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-36c745e6-9fcd-4b60-a922-eb9d9714848d req-c9ddbf8d-c938-465e-96cd-21b148f897c3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 210 time: 0.1439066 Nov 11 11:40:43.059913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.188114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.189319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:43.190022 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.192675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Unset dirty status for tenant:a02628e0c7ca4087b444fea3b13a9a5e on resource:security_group {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:43.195643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:43.197776 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=a5ef9778bd12414dbe07f947f19f6e17&name=default HTTP/1.1" status: 200 len: 2647 time: 4.2190399 Nov 11 11:40:43.198568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58742) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:43.304902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] For port d406b7f5-8b66-41f4-b933-ed75fdf4d06e, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:43.370396 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-67d666a9-51f0-4a0f-a25f-7f2022aac1ea service neutron] 10.222.0.11 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6279118 Nov 11 11:40:43.372330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] For port d406b7f5-8b66-41f4-b933-ed75fdf4d06e, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,segment=NetworkSegment(f738a606-21d7-4c80-9a99-5e69bf9a03d2),segment_id=f738a606-21d7-4c80-9a99-5e69bf9a03d2)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:43.465813 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 2.3840380 Nov 11 11:40:43.476584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.479063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58758) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:43.493306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Request body: {'subnet': {'network_id': 'ea935c94-6f15-4c33-ac01-d007674fddf3', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-160572544-subnet', 'tenant_id': '34287fb3f486470ab12524f947235f8c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:43.506103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:43.511746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Usage tracker for resource:subnet and tenant:34287fb3f486470ab12524f947235f8c is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:43.525557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:43.528225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:43.547660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:43.558616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 22d627d7-6ff0-48cd-b93e-559401603c6a completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:43.560163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Pushing event updated for resources: {'Network': ['ID=ea935c94-6f15-4c33-ac01-d007674fddf3,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:43.573296 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.378s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:43.581289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network ea935c94-6f15-4c33-ac01-d007674fddf3 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:40:43.636414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 22d627d7-6ff0-48cd-b93e-559401603c6a triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:43.636701 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.673339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Made reservation on behalf of 34287fb3f486470ab12524f947235f8c for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:43.678360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Notify callbacks [] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.728708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-11942031-d3f1-4b17-98be-f6a97a12c8b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.752054 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a819c133-b334-420c-8a7d-b6994628d2aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.766645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.769347 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] 10.222.0.60 "PUT /v2.0/ports/d406b7f5-8b66-41f4-b933-ed75fdf4d06e HTTP/1.1" status: 200 len: 1093 time: 5.1572568 Nov 11 11:40:43.775341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-5b56a322-0a92-4478-b1da-52f66137de29 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Synchronizing usage tracker for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:security_group {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:43.778186 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43d2e685-b837-4758-b0be-7f4308a961e4', 'tag': 'd406b7f5-8b66-41f4-b933-ed75fdf4d06e'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:40:43.784190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.877397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:41Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:43.890385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9b2a3fa-8706-47d5-903b-18cbee8cad1f None None] The sync data for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi is: [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:41Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:40:43.901402 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:43.905919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Pushing event updated for resources: {'Port': ['ID=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:43.915090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.389s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:43.961317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-11942031-d3f1-4b17-98be-f6a97a12c8b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:44.005135 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-9b485ba2-d95e-40ef-a8ff-258d70190eee service neutron] 10.222.0.11 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6264441 Nov 11 11:40:44.009175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 22d627d7-6ff0-48cd-b93e-559401603c6a, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=22d627d7-6ff0-48cd-b93e-559401603c6a,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:44.053177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:44.056063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:44.091026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-5b56a322-0a92-4478-b1da-52f66137de29 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Unset dirty status for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:security_group {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:44.093043 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-5b56a322-0a92-4478-b1da-52f66137de29 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1661240300&fields=id&tenant_id=49b88e3cf8f748be91f37e0b9caccf6d HTTP/1.1" status: 200 len: 267 time: 0.6348584 Nov 11 11:40:44.095754 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:44.112999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:44.219682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=22d627d7-6ff0-48cd-b93e-559401603c6a,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:44.223833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:44.230448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Pushing event updated for resources: {'Subnet': ['ID=a70fd9f3-0076-4509-a9d5-39b88daefbd0,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:44.237244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:44.273026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Checking segment: {'id': '9a4ab315-c754-46d6-b190-2a906fd4a397', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1003, 'network_id': 'ea935c94-6f15-4c33-ac01-d007674fddf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:44.273394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Network hostable DHCP agents. Network: ea935c94-6f15-4c33-ac01-d007674fddf3, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:40:44.351053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Network ea935c94-6f15-4c33-ac01-d007674fddf3 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:40:44.434646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, ea935c94-6f15-4c33-ac01-d007674fddf3) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:44.445967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed451588-682e-4e70-9349-a98664692d90 None None] Network ea935c94-6f15-4c33-ac01-d007674fddf3 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:44.446510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:44.447205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:44.453260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-97f79a5c-63f1-426a-af75-bdbed86aa0e6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:44.454894 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-97f79a5c-63f1-426a-af75-bdbed86aa0e6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 816 time: 0.3412728 Nov 11 11:40:44.557574 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.0760238 Nov 11 11:40:44.636241 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-00c12537-3ccd-4216-a65e-1d0f20e67b8f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/quotas/49b88e3cf8f748be91f37e0b9caccf6d HTTP/1.1" status: 200 len: 375 time: 0.1410387 Nov 11 11:40:44.657027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device b5579f75-6ab0-4891-a00f-12003d90eb5a up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:44.687727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-11942031-d3f1-4b17-98be-f6a97a12c8b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:44.707603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:44.736187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11942031-d3f1-4b17-98be-f6a97a12c8b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=895869dc-d045-49b1-abf4-c15b99dc21e0,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:44.741624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-11942031-d3f1-4b17-98be-f6a97a12c8b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:44.887280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58792) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:44.905487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port b5579f75-6ab0-4891-a00f-12003d90eb5a completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:44.909431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.003573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port b5579f75-6ab0-4891-a00f-12003d90eb5a triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:45.004373 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.052809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Deleting subnet 8fce330a-b038-4231-8ebd-de7633ef0eac {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:40:45.244837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.246313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e03203dd-9d1c-4792-9d28-236b4a3f8d2d None None] Network ea935c94-6f15-4c33-ac01-d007674fddf3 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:40:45.246862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-11942031-d3f1-4b17-98be-f6a97a12c8b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.246862 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-11942031-d3f1-4b17-98be-f6a97a12c8b1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/895869dc-d045-49b1-abf4-c15b99dc21e0 HTTP/1.1" status: 204 len: 168 time: 1.8876591 Nov 11 11:40:45.246862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23e9ff8-08e7-4f11-89a7-619b89dfc873 req-43df6f3f-8314-4f24-bd60-702730918d42 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:45.246862 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a23e9ff8-08e7-4f11-89a7-619b89dfc873 req-43df6f3f-8314-4f24-bd60-702730918d42 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 943 time: 0.6425002 Nov 11 11:40:45.247559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.247559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.248560 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-8f95e56b-9544-4ca2-8649-10f905460a7a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&fields=id HTTP/1.1" status: 200 len: 348 time: 0.5981004 Nov 11 11:40:45.293546 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a23e9ff8-08e7-4f11-89a7-619b89dfc873 req-80f08219-32d8-4cb5-a06b-c7dd339daf89 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1416523 Nov 11 11:40:45.530560 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-c0db71e2-ee12-4180-a3ed-1b0125808118 service neutron] 10.222.0.11 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2895689 Nov 11 11:40:45.577867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.645027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.664060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d339b99a-e024-4686-b825-3404097fa3cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:45.682786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port b5579f75-6ab0-4891-a00f-12003d90eb5a, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=b5579f75-6ab0-4891-a00f-12003d90eb5a,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:45.730673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.731760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 22d627d7-6ff0-48cd-b93e-559401603c6a up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:45.757572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.766598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:45.771900 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/8fce330a-b038-4231-8ebd-de7633ef0eac HTTP/1.1" status: 204 len: 168 time: 0.8829994 Nov 11 11:40:45.776417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58810) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:45.778641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8fce330a-b038-4231-8ebd-de7633ef0eac,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:45.786331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:45.790398 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-260fb1b2-639d-4d27-81ae-07f5e111dc7d req-c016fa0d-4fe7-4cb4-8dbf-26d9d23ba8d5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 210 time: 0.0653751 Nov 11 11:40:45.835843 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-7934472e-3d5f-42a1-b0ed-17b2b8d2dc24 service neutron] 10.222.0.11 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3040512 Nov 11 11:40:45.899833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=b5579f75-6ab0-4891-a00f-12003d90eb5a,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:45.918035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:45.952186 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 22d627d7-6ff0-48cd-b93e-559401603c6a triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:45.952622 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:45.989108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:46.079304 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13254cb2-95e4-472b-af4b-25f18fe5f6c5 req-107631f2-7dcb-4a2b-b009-b33c403b74b5 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 210 time: 0.0781052 Nov 11 11:40:46.250795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:46.289726 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-878c18b7-a132-47fc-9f1a-a8d71a709309 req-4c11b6e4-73ab-4b65-bdf0-adf412ba8fc7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 210 time: 0.0769668 Nov 11 11:40:46.317602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > segment before_delete 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.317955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.318817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.319132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > port after_create 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.327887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > port after_delete 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.327887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > port after_update 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.327887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > segment after_delete 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.327887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.327887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.327887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > subnet after_update 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.410175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device b5579f75-6ab0-4891-a00f-12003d90eb5a up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:46.534283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port b5579f75-6ab0-4891-a00f-12003d90eb5a triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:46.536800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:46.536935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 58836) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:46.577656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:46.677513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.678549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.678549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > subnet before_create 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.678738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Subscribe: > subnet before_update 55550000 {{(pid=88328) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:40:46.679284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4e704c47-c75b-464c-aaf5-fc9a9e2ba59c']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:46.700218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7151ed62-7d8b-480f-90e2-d18f75511f30') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:46.700540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7151ed62-7d8b-480f-90e2-d18f75511f30') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:46.712154 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:46.720623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Usage tracker for resource:security_group_rule and tenant:098f7ded9bc94651b80d2c75e297baa6 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:46.725427 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43d2e685-b837-4758-b0be-7f4308a961e4', 'tag': 'd406b7f5-8b66-41f4-b933-ed75fdf4d06e', 'status': 'completed', 'code': 200} Nov 11 11:40:46.726266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:46.726733 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:46.742882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:46.743583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:46.751738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Releasing vlan 1024 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:40:46.752274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:46.767645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc45e754-9e5a-4cc1-9f6c-ce4432e2a619 req-2aa7d129-fe89-4e65-b236-eed5f272c9a8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:46.770698 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc45e754-9e5a-4cc1-9f6c-ce4432e2a619 req-2aa7d129-fe89-4e65-b236-eed5f272c9a8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 943 time: 0.1964684 Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1917: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding will be deprecated in SQLAlchemy 1.4, and will be disallowed in a future release. viewonly relationships should not be mutated (this warning may be suppressed after 10 occurrences) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: (self, other), Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1917: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags will be deprecated in SQLAlchemy 1.4, and will be disallowed in a future release. viewonly relationships should not be mutated (this warning may be suppressed after 10 occurrences) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: (self, other), Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:40:46.775811 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:40:46.894471 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc45e754-9e5a-4cc1-9f6c-ce4432e2a619 req-449196e1-06da-43d4-a100-7218a24ede3c tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1112745 Nov 11 11:40:46.921564 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-f19a0b56-d285-4c5b-8442-d465419e4e6f service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=494d10266beb49e2a9a6952aeefc82ef&device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 1096 time: 0.1103537 Nov 11 11:40:47.013078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.018736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:47.040059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.043126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Pushing event deleted for resources: {'Network': ['ID=4e704c47-c75b-464c-aaf5-fc9a9e2ba59c,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:47.046899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:47.050698 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] 10.222.0.11 "DELETE /v2.0/networks/4e704c47-c75b-464c-aaf5-fc9a9e2ba59c HTTP/1.1" status: 204 len: 168 time: 1.2632170 Nov 11 11:40:47.055804 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58848) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:47.073089 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2081a0f4-19c9-4688-ade3-4fa60e3d964a req-dbf6d213-328e-4ebb-ad65-bc361bcab787 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 210 time: 0.0595844 Nov 11 11:40:47.074377 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-90e5352c-2e9a-4b8c-a52d-90bb8b523983 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d406b7f5-8b66-41f4-b933-ed75fdf4d06e HTTP/1.1" status: 200 len: 217 time: 0.1261044 Nov 11 11:40:47.161696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Deleting subnet a70fd9f3-0076-4509-a9d5-39b88daefbd0 {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:40:47.165588 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-1848de85-38af-40c4-93be-09b66f98bc69 service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:47.167022 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-1848de85-38af-40c4-93be-09b66f98bc69 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6475e617-8ff3-42cb-968f-868863503d26 HTTP/1.1" status: 200 len: 851 time: 0.0839956 Nov 11 11:40:47.167623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.193471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.225918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036850920695'] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.300796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.329003 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-32278ff8-db16-4e60-87cb-b21438b21a74 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=7c4246da-4773-4e75-9daa-b9c878c13272&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0698395 Nov 11 11:40:47.329342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.376218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d4fbc8e4-2a73-4d4b-b9d4-dbbe82e2710c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:47.451752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2678040', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2638849'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.457301 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:47.496890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a70fd9f3-0076-4509-a9d5-39b88daefbd0,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:47.500506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:47.506126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.516801 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/a70fd9f3-0076-4509-a9d5-39b88daefbd0 HTTP/1.1" status: 204 len: 168 time: 0.4567013 Nov 11 11:40:47.516999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58862) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:47.521809 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-562fdd49-7c6d-4f8d-9c5e-0262ead9cd5b req-01151a15-ea8d-4e89-82f3-a3e084ae8591 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 210 time: 0.1523981 Nov 11 11:40:47.672771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.60', 64955) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:47.680865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.714516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25dd6af0-af10-4281-8320-83573b6cd3e0,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:47.719006 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9884585c-5878-4d47-8e8c-468b92bbfab4 req-7f169ca7-ba41-4c1b-adec-2d956dcae3d9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 210 time: 0.2326212 Nov 11 11:40:47.719847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:47.726755 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-e4ffb36e-14be-4a78-a9d7-58de8167324c service neutron] 10.222.0.60 "GET /v2.0/networks/7c4246da-4773-4e75-9daa-b9c878c13272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3586218 Nov 11 11:40:47.730937 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=098f7ded9bc94651b80d2c75e297baa6&name=default HTTP/1.1" status: 200 len: 2647 time: 1.1910574 Nov 11 11:40:47.734334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58874) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:47.857855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.909190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ea935c94-6f15-4c33-ac01-d007674fddf3']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:47.930955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a4ab315-c754-46d6-b190-2a906fd4a397') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:47.930955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a4ab315-c754-46d6-b190-2a906fd4a397') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:40:47.946832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.976678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.979286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-127c0c32-f71c-4e3e-a23b-990ec7ed5bab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:47.980140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-6cf90343-a4df-4be8-8068-316c660a1e9c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:47.982023 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-6cf90343-a4df-4be8-8068-316c660a1e9c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 811 time: 0.3027697 Nov 11 11:40:48.007755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-127c0c32-f71c-4e3e-a23b-990ec7ed5bab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:48.023495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Releasing vlan 1003 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:40:48.023948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:40:48.042123 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:40:48.096149 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c813d884-3a96-45a2-b7a2-9fae2fec8454 req-9654939c-4f80-401f-9abc-87621496d281 service neutron] 10.222.0.60 "GET /v2.0/networks/7c4246da-4773-4e75-9daa-b9c878c13272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3612680 Nov 11 11:40:48.106453 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-7fbe0caf-4e31-4313-8e04-5f6d9dc90e74 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be HTTP/1.1" status: 200 len: 380 time: 0.1082339 Nov 11 11:40:48.121708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'port': {'device_id': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'admin_state_up': True, 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'security_groups': ['4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:48.264208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d490b12-138a-4ba2-a65d-beb2a24fe87b req-910ef4af-8fa7-4f88-b05c-c645a48a64fd tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:48.265792 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d490b12-138a-4ba2-a65d-beb2a24fe87b req-910ef4af-8fa7-4f88-b05c-c645a48a64fd tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 943 time: 0.2301095 Nov 11 11:40:48.332970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:48.349474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:48.362475 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d490b12-138a-4ba2-a65d-beb2a24fe87b req-fc36fefc-41b3-419b-a62d-3dc060b180d7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870037 Nov 11 11:40:48.445735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:48.449998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:48.450156 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Made reservation on behalf of 307ee8e0c17a4e1ebce8db1a0c8ca6be for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:48.461093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:48.479116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:48.493198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Pushing event deleted for resources: {'Network': ['ID=ea935c94-6f15-4c33-ac01-d007674fddf3,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:48.501777 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] 10.222.0.11 "DELETE /v2.0/networks/ea935c94-6f15-4c33-ac01-d007674fddf3 HTTP/1.1" status: 204 len: 168 time: 0.9835136 Nov 11 11:40:48.502744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.60', 64961) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:48.503675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:48.567933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-127c0c32-f71c-4e3e-a23b-990ec7ed5bab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:48.581736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9693b9aa-23c7-4d2f-883e-8f95f9391d0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:48.599472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-127c0c32-f71c-4e3e-a23b-990ec7ed5bab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25dd6af0-af10-4281-8320-83573b6cd3e0,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:48.608168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-127c0c32-f71c-4e3e-a23b-990ec7ed5bab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:48.629543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-127c0c32-f71c-4e3e-a23b-990ec7ed5bab admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:48.633290 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-127c0c32-f71c-4e3e-a23b-990ec7ed5bab admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/25dd6af0-af10-4281-8320-83573b6cd3e0 HTTP/1.1" status: 204 len: 168 time: 0.8952243 Nov 11 11:40:48.674545 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-636a5ba8-9c3f-43a2-bacd-03b64e8fdaa0 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=494d10266beb49e2a9a6952aeefc82ef&device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 1096 time: 0.1695485 Nov 11 11:40:48.727626 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f46b612a-80fc-4582-86c6-3c0515376a0d req-31323715-dc2c-4cf1-a7c1-ccf365d42e03 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 210 time: 0.1653738 Nov 11 11:40:48.973067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-5b1fe003-acd0-4c43-9a32-489382280d16 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:48.974702 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-5b1fe003-acd0-4c43-9a32-489382280d16 service neutron] 10.222.0.60 "GET /v2.0/networks?id=7c4246da-4773-4e75-9daa-b9c878c13272 HTTP/1.1" status: 200 len: 913 time: 0.2915533 Nov 11 11:40:49.087140 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-621b905e-ff17-4d41-b6d1-6f3119452dd1 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d406b7f5-8b66-41f4-b933-ed75fdf4d06e HTTP/1.1" status: 200 len: 217 time: 0.1051276 Nov 11 11:40:49.158013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58914) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:49.267048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-d73fc566-a091-4876-b904-a87cf9aa4715 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:49.270509 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-d73fc566-a091-4876-b904-a87cf9aa4715 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6475e617-8ff3-42cb-968f-868863503d26 HTTP/1.1" status: 200 len: 851 time: 0.1754231 Nov 11 11:40:49.304454 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9db4cc41-5c07-417a-82d7-204525937f2f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=55ff6abc743549b69ad556ecbc404728&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1416295 Nov 11 11:40:49.305747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 58926) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:49.371668 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-36b0064b-58c0-488d-84c5-858a3dbeca8b service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=7c4246da-4773-4e75-9daa-b9c878c13272&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0643494 Nov 11 11:40:49.394948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ee347e43-74dc-47ac-9a30-db98421a1259 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:49.396603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ee347e43-74dc-47ac-9a30-db98421a1259 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 819 time: 0.8977242 Nov 11 11:40:49.429255 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b3084ee-1a07-4148-8762-1f6c6eec309b req-afb8a931-7ac4-4232-a28a-9259d76b3ea9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 210 time: 0.4792399 Nov 11 11:40:49.450028 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fadc298b-307e-4035-b259-1b8dba24ac6f req-1b657211-205f-498b-821a-2ac6106e9e64 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 210 time: 0.5073733 Nov 11 11:40:49.489758 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Request body: {'port': {'device_id': '66d508f1-193d-4909-a4cd-59458908d0df', 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f', 'admin_state_up': True, 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:49.551547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.60', 64966) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:49.673445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a6ee411c-9293-4fef-a945-4080ff6f817f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:49.743358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a6ee411c-9293-4fef-a945-4080ff6f817f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:49.754696 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-52617815-6d88-49aa-8c28-269903cf9893 service neutron] 10.222.0.60 "GET /v2.0/networks/7c4246da-4773-4e75-9daa-b9c878c13272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3717606 Nov 11 11:40:49.795630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Allocated IP 172.20.0.10 (6f90028e-6513-4ec3-884d-7830777c7626/f175d5dc-0139-4051-bd21-8da204b3ae78/4883439e-6709-46bc-b7b3-a1dfa2128b0c) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:50.010031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:50.059503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-8009ae39-9973-411b-9aa6-7ba516f735ea tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:50.061149 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-8009ae39-9973-411b-9aa6-7ba516f735ea tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 819 time: 0.5063298 Nov 11 11:40:50.062994 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7a91079b-1a1c-4c74-96bf-be224ee13bdf req-af158877-383e-4071-9d10-32573ec6e200 service neutron] 10.222.0.60 "GET /v2.0/networks/7c4246da-4773-4e75-9daa-b9c878c13272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3013611 Nov 11 11:40:50.077684 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Usage tracker for resource:port and tenant:d45efb8e286d41399941bdf844af2b3c is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:50.107570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:50.115334 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a55cea53-dc30-4d50-a4ef-682029d22147 req-5322ff42-fe78-4c16-9964-645cb87eb5fe tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 210 time: 0.1134632 Nov 11 11:40:50.123442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Request body: {'port': {'device_id': '3ac7a6af-a9e4-4c03-894d-e9bad44fac64', 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f', 'admin_state_up': True, 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:50.151043 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:50.171868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a6ee411c-9293-4fef-a945-4080ff6f817f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:50.192135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:50.210994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ee411c-9293-4fef-a945-4080ff6f817f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63a94d11-699c-4635-8c8b-a7b597d6251f,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:50.260505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a6ee411c-9293-4fef-a945-4080ff6f817f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:50.268153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a6ee411c-9293-4fef-a945-4080ff6f817f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:50.269395 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a6ee411c-9293-4fef-a945-4080ff6f817f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/63a94d11-699c-4635-8c8b-a7b597d6251f HTTP/1.1" status: 204 len: 168 time: 0.9599805 Nov 11 11:40:50.303456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc1137ac-ac61-41b1-9257-733e9cb86bbe req-69081f58-8de8-466c-8b93-75bc3abfa780 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:50.304621 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc1137ac-ac61-41b1-9257-733e9cb86bbe req-69081f58-8de8-466c-8b93-75bc3abfa780 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 943 time: 0.6323361 Nov 11 11:40:50.323195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Made reservation on behalf of d45efb8e286d41399941bdf844af2b3c for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:50.332967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:50.339119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-bd326f13-6e39-416e-8a03-e00a8058c422 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:50.340295 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-bd326f13-6e39-416e-8a03-e00a8058c422 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Synchronizing usage tracker for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:network {{(pid=88328) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:50.453235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-bd326f13-6e39-416e-8a03-e00a8058c422 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Unset dirty status for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:network {{(pid=88328) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:50.454531 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-bd326f13-6e39-416e-8a03-e00a8058c422 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 816 time: 0.3440554 Nov 11 11:40:50.585516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:50.590388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Usage tracker for resource:port and tenant:d45efb8e286d41399941bdf844af2b3c is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:50.593903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:50.604227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:50.612841 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc1137ac-ac61-41b1-9257-733e9cb86bbe req-1ec325b9-66b8-4bb7-b6f2-153ddbea8820 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2906232 Nov 11 11:40:50.736504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-b4ddd95e-0345-4137-af9a-06f02ae8f415 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Synchronizing usage tracker for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:security_group {{(pid=88328) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:50.749194 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-b4ddd95e-0345-4137-af9a-06f02ae8f415 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Unset dirty status for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:security_group {{(pid=88328) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:50.750495 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-b4ddd95e-0345-4137-af9a-06f02ae8f415 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=49b88e3cf8f748be91f37e0b9caccf6d HTTP/1.1" status: 200 len: 380 time: 0.2849104 Nov 11 11:40:50.864483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'port': {'device_id': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'admin_state_up': True, 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'security_groups': ['9c29ba10-7781-4132-85a5-1106bd95cd6b']}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:51.019226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:51.024070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:port and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:51.027129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:51.039432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:52.156590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Made reservation on behalf of 49b88e3cf8f748be91f37e0b9caccf6d for: {'port': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:52.164891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:52.236027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-427ae6f8-ea1e-4055-a687-0312181f43f8 req-fbe532b1-8005-4b6e-ace6-4dbf890f7744 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 210 time: 0.0735362 Nov 11 11:40:52.329277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:52.369882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Transition to ACTIVE for port object 4883439e-6709-46bc-b7b3-a1dfa2128b0c will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:52.372392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Made reservation on behalf of d45efb8e286d41399941bdf844af2b3c for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:40:52.378917 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:52.419947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device d406b7f5-8b66-41f4-b933-ed75fdf4d06e details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:40:52.447647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Allocated IP 172.20.0.7 (d616b076-b5a7-4954-b999-21a3b4c0cf2f/c0ace514-c466-40d3-9d56-40ff46839783/2149ca07-49c8-44c1-8765-765da866d5e8) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:52.565839 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c91b5c7e-edf2-486b-a29e-bc60cc7224ef req-51f59f1c-c06a-459a-87d6-b970b91a371e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 210 time: 0.4023724 Nov 11 11:40:52.593175 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d4a7f060-eb99-4237-9410-d5717b59e25c req-e2964f12-0249-4907-a356-0a0de5724f16 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 210 time: 0.1857038 Nov 11 11:40:52.673339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port d406b7f5-8b66-41f4-b933-ed75fdf4d06e, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,segment=NetworkSegment(f738a606-21d7-4c80-9a99-5e69bf9a03d2),segment_id=f738a606-21d7-4c80-9a99-5e69bf9a03d2)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:52.687584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': 'd406b7f5-8b66-41f4-b933-ed75fdf4d06e', 'network_id': '7c4246da-4773-4e75-9daa-b9c878c13272', 'port_id': 'd406b7f5-8b66-41f4-b933-ed75fdf4d06e', 'mac_address': 'fa:16:3e:2b:f9:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1016, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6475e617-8ff3-42cb-968f-868863503d26', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:40:52.743326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:52.748094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:52.753851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:52.767535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d406b7f5-8b66-41f4-b933-ed75fdf4d06e {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:40:52.861269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Network 6f90028e-6513-4ec3-884d-7830777c7626 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:52.862551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:52.872475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:52.874440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:52.875172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:52.883793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'Port': ['ID=4883439e-6709-46bc-b7b3-a1dfa2128b0c,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:52.892115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:52.911646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Allocated IP 172.20.0.10 (95fd47ac-3c3a-4852-88d6-8eed6cc12159/438f756e-e154-4e6d-b79f-74ad54d1cabe/48b55264-0eab-46d7-abe8-ce455a036f49) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:52.922873 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port d406b7f5-8b66-41f4-b933-ed75fdf4d06e, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,segment=NetworkSegment(f738a606-21d7-4c80-9a99-5e69bf9a03d2),segment_id=f738a606-21d7-4c80-9a99-5e69bf9a03d2)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:52.967402 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:52.970720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:53.013138 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.9001248 Nov 11 11:40:53.045667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Request body: {'port': {'device_id': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:53.082010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:53.088517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:53.118134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59006) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:53.241049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e592ba24-6db6-409f-81ca-03911bdd2f59 req-8cd387b2-dd73-4b18-b0ea-2428a125deb6 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:53.243334 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e592ba24-6db6-409f-81ca-03911bdd2f59 req-8cd387b2-dd73-4b18-b0ea-2428a125deb6 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 944 time: 0.2854362 Nov 11 11:40:53.347852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e0694816-e9e1-4aad-9efa-14079b634edc None None] Provisioning for port 4883439e-6709-46bc-b7b3-a1dfa2128b0c completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:53.354115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e0694816-e9e1-4aad-9efa-14079b634edc None None] Provisioning complete for port 4883439e-6709-46bc-b7b3-a1dfa2128b0c triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:53.354530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e0694816-e9e1-4aad-9efa-14079b634edc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.391417 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3f4a3b2f-51d9-4da9-aec5-d6478b4026a6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=34287fb3f486470ab12524f947235f8c&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2716019 Nov 11 11:40:53.403323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59018) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:53.475406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e0694816-e9e1-4aad-9efa-14079b634edc None None] Port 4883439e-6709-46bc-b7b3-a1dfa2128b0c cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:40:53.506162 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.555956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Transition to ACTIVE for port object 48b55264-0eab-46d7-abe8-ce455a036f49 will not be triggered until provisioned by entity DHCP. {{(pid=88328) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:53.598383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-843cfbd1-8f38-4e71-9d3c-da8e0d274ebd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.641820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-843cfbd1-8f38-4e71-9d3c-da8e0d274ebd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.705323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.716116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:53.763886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-843cfbd1-8f38-4e71-9d3c-da8e0d274ebd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.802385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:53.802772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-adb3cb5f-5bbf-4c7b-a9ef-4c3535d07eb7 req-0452c552-dae6-4ea8-9a5b-79bea32fae5b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Synchronizing usage tracker for tenant:d45efb8e286d41399941bdf844af2b3c on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:53.807411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:53.810322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.813648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:53.849565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:53.860706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:53.862388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2ffdf817-baef-45c2-85ca-1ac26a32f998 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.087s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:53.875787 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e592ba24-6db6-409f-81ca-03911bdd2f59 req-b985a17b-e757-4239-8290-0e6f6f70dc62 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5590878 Nov 11 11:40:53.886254 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-843cfbd1-8f38-4e71-9d3c-da8e0d274ebd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.890544 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-843cfbd1-8f38-4e71-9d3c-da8e0d274ebd admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/6b9397db-b283-4db2-a880-ebf154214111 HTTP/1.1" status: 204 len: 168 time: 0.4861221 Nov 11 11:40:53.894246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-843cfbd1-8f38-4e71-9d3c-da8e0d274ebd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b9397db-b283-4db2-a880-ebf154214111,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:53.898723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-843cfbd1-8f38-4e71-9d3c-da8e0d274ebd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:53.931816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:53.932552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:53.957439 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:54.003228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-adb3cb5f-5bbf-4c7b-a9ef-4c3535d07eb7 req-0452c552-dae6-4ea8-9a5b-79bea32fae5b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Unset dirty status for tenant:d45efb8e286d41399941bdf844af2b3c on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:54.019862 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-adb3cb5f-5bbf-4c7b-a9ef-4c3535d07eb7 req-0452c552-dae6-4ea8-9a5b-79bea32fae5b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 210 time: 0.3064775 Nov 11 11:40:54.025216 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.1731958 Nov 11 11:40:54.370850 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-35c9328b-a475-4543-a933-d2479f2741be None None] Provisioning for port 48b55264-0eab-46d7-abe8-ce455a036f49 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:54.379227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-35c9328b-a475-4543-a933-d2479f2741be None None] Provisioning complete for port 48b55264-0eab-46d7-abe8-ce455a036f49 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:54.380093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-35c9328b-a475-4543-a933-d2479f2741be None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:54.393083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:54.440469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:54.458448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-35c9328b-a475-4543-a933-d2479f2741be None None] Port 48b55264-0eab-46d7-abe8-ce455a036f49 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:40:54.497176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Network d616b076-b5a7-4954-b999-21a3b4c0cf2f is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:54.517202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59048) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:54.517423 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:54.537258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:54.550153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:54.550153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:54.580320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Allocated IP 172.20.0.3 (d616b076-b5a7-4954-b999-21a3b4c0cf2f/c0ace514-c466-40d3-9d56-40ff46839783/e3d4fb61-8388-4546-8f10-81ccafd1477a) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:40:54.590522 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9a7c69-7a98-4506-a4fd-52763d6100ef req-81d32a50-aed6-4d1d-bb20-410beeb7c264 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:54.592198 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9f9a7c69-7a98-4506-a4fd-52763d6100ef req-81d32a50-aed6-4d1d-bb20-410beeb7c264 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 932 time: 0.4525695 Nov 11 11:40:54.652233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Pushing event updated for resources: {'Port': ['ID=2149ca07-49c8-44c1-8765-765da866d5e8,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:54.662181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:54.670346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30e62f5-f426-42db-8a89-5d7f1b7510cc req-28714c8c-ee7f-49ce-b721-018f2a05420e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:54.671127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-f30e62f5-f426-42db-8a89-5d7f1b7510cc req-28714c8c-ee7f-49ce-b721-018f2a05420e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Synchronizing usage tracker for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:40:54.688366 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.2717440 Nov 11 11:40:54.688572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Request body: {'port': {'device_id': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:54.782629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:54.811480 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9f9a7c69-7a98-4506-a4fd-52763d6100ef req-b1ccdf3a-c6fd-40fd-b49e-4b77745acc0c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2042241 Nov 11 11:40:54.826555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-f30e62f5-f426-42db-8a89-5d7f1b7510cc req-28714c8c-ee7f-49ce-b721-018f2a05420e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Unset dirty status for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:40:54.828481 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f30e62f5-f426-42db-8a89-5d7f1b7510cc req-28714c8c-ee7f-49ce-b721-018f2a05420e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 932 time: 0.6396806 Nov 11 11:40:54.887885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:54.900538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Usage tracker for resource:security_group_rule and tenant:113f077d38f6456489c41a7cdcb702da is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:54.906272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:54.909225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4883439e-6709-46bc-b7b3-a1dfa2128b0c {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:40:54.913958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:54.925817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:54.985155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.029904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Transition to ACTIVE for port object 4883439e-6709-46bc-b7b3-a1dfa2128b0c will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:55.037111 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f30e62f5-f426-42db-8a89-5d7f1b7510cc req-b7aee52a-73f1-4f7e-b7c2-6d68a844f8be tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1973326 Nov 11 11:40:55.071053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.089940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:55.239996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.285883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.311240 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2ed212f7-34df-4d14-b544-47b9ac93b9a9 req-bf7ca7a2-d05b-4d5a-9d3b-95e9b0a2e36d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 210 time: 0.1170213 Nov 11 11:40:55.355527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Pushing event updated for resources: {'Port': ['ID=4883439e-6709-46bc-b7b3-a1dfa2128b0c,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:55.361214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:55.373261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.441764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:55.451183 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=113f077d38f6456489c41a7cdcb702da&name=default HTTP/1.1" status: 200 len: 2647 time: 0.9319444 Nov 11 11:40:55.464209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7cba2a9-8fe7-4a7d-9bbf-6f1578e5884b req-1b610808-f78f-4fc0-97b0-1d8eb7b50c45 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:55.464209 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b7cba2a9-8fe7-4a7d-9bbf-6f1578e5884b req-1b610808-f78f-4fc0-97b0-1d8eb7b50c45 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 944 time: 0.3833871 Nov 11 11:40:55.464209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 59076) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:55.465709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Attempting to bind port 4883439e-6709-46bc-b7b3-a1dfa2128b0c on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:55.466116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Attempting to bind port 4883439e-6709-46bc-b7b3-a1dfa2128b0c by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:55.466770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Attempting to bind port 4883439e-6709-46bc-b7b3-a1dfa2128b0c on network 6f90028e-6513-4ec3-884d-7830777c7626 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:55.493753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 48b55264-0eab-46d7-abe8-ce455a036f49 {{(pid=88328) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:40:55.499718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c7722c5-a75c-42ea-8ac8-ffe717f52fac,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:55.503714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:55.509887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.518034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.524827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Port 4883439e-6709-46bc-b7b3-a1dfa2128b0c on network 6f90028e-6513-4ec3-884d-7830777c7626 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:40:55.525201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Attempting to bind port 4883439e-6709-46bc-b7b3-a1dfa2128b0c on network 6f90028e-6513-4ec3-884d-7830777c7626 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:55.538706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Transition to ACTIVE for port object 48b55264-0eab-46d7-abe8-ce455a036f49 will not be triggered until provisioned by entity L2. {{(pid=88328) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:55.549141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:55.594248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.600560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:55.617741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:55.618121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Checking segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:55.618550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Bound using segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:55.619049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Bound port: 4883439e-6709-46bc-b7b3-a1dfa2128b0c, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:55.619479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.676505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Network d616b076-b5a7-4954-b999-21a3b4c0cf2f is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:40:55.680459 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b7cba2a9-8fe7-4a7d-9bbf-6f1578e5884b req-0d358b69-c911-4200-9ed4-5b3adb128d73 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1976433 Nov 11 11:40:55.722381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:40:55.741940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Pushing event updated for resources: {'Port': ['ID=e3d4fb61-8388-4546-8f10-81ccafd1477a,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:55.748910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:40:55.759201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:55.759933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.771406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:55.779312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Request body: {'port': {'device_id': '66d508f1-193d-4909-a4cd-59458908d0df', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:55.779751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:55.789530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:55.816507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-06f55316-db2a-4a88-b201-92b240fe65f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.901625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-06f55316-db2a-4a88-b201-92b240fe65f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:55.938611 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.8363216 Nov 11 11:40:55.966127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Attempting to bind port 48b55264-0eab-46d7-abe8-ce455a036f49 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88328) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:55.966452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Attempting to bind port 48b55264-0eab-46d7-abe8-ce455a036f49 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'}] {{(pid=88328) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:55.966829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Attempting to bind port 48b55264-0eab-46d7-abe8-ce455a036f49 on network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 {{(pid=88328) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:55.990812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Port 48b55264-0eab-46d7-abe8-ce455a036f49 on network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88328) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:40:55.991214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Attempting to bind port 48b55264-0eab-46d7-abe8-ce455a036f49 on network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 {{(pid=88328) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:56.001721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88328) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:56.002265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Checking segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:56.002978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Bound using segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} {{(pid=88328) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:56.003797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Bound port: 48b55264-0eab-46d7-abe8-ce455a036f49, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'}}] {{(pid=88328) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:56.004313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:56.028297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] For port 4883439e-6709-46bc-b7b3-a1dfa2128b0c, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:56.133751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] For port 4883439e-6709-46bc-b7b3-a1dfa2128b0c, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:56.148002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:56.175219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, cleared binding levels {{(pid=88328) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:56.181573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88328) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:56.217669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:56.224703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:56.283522 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:56.285089 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] 10.222.0.60 "PUT /v2.0/ports/48b55264-0eab-46d7-abe8-ce455a036f49 HTTP/1.1" status: 200 len: 1094 time: 1.6036642 Nov 11 11:40:56.288204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:40:56.345213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=3']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:56.350142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:56.356513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:56.403091 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:56.565952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:56.565952 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] 10.222.0.60 "PUT /v2.0/ports/4883439e-6709-46bc-b7b3-a1dfa2128b0c HTTP/1.1" status: 200 len: 1094 time: 3.5264075 Nov 11 11:40:56.566860 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'tag': '4883439e-6709-46bc-b7b3-a1dfa2128b0c'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:40:56.604638 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Pushing event updated for resources: {'Port': ['ID=4883439e-6709-46bc-b7b3-a1dfa2128b0c,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:56.607698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-06f55316-db2a-4a88-b201-92b240fe65f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:56.612578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:56.670331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c7a4ea7f-cbc4-4fb5-96ae-2391a0811793 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:56.708552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f55316-db2a-4a88-b201-92b240fe65f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c7722c5-a75c-42ea-8ac8-ffe717f52fac,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:56.718447 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd7e6ec-a8d1-4935-8d51-5bde3064e11a req-5b38a1f6-233b-4f19-beb7-0b48a6cebd82 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:56.720641 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ecd7e6ec-a8d1-4935-8d51-5bde3064e11a req-5b38a1f6-233b-4f19-beb7-0b48a6cebd82 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.6773350 Nov 11 11:40:56.726521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-06f55316-db2a-4a88-b201-92b240fe65f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:56.758731 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-06f55316-db2a-4a88-b201-92b240fe65f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:56.763411 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-06f55316-db2a-4a88-b201-92b240fe65f1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0c7722c5-a75c-42ea-8ac8-ffe717f52fac HTTP/1.1" status: 204 len: 168 time: 1.2962816 Nov 11 11:40:56.784251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f847c95e-0541-476b-9eb8-f478ff8b0484 req-bf19bc22-7e3e-4a1f-8a40-cfcba5c38406 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:56.794188 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f847c95e-0541-476b-9eb8-f478ff8b0484 req-bf19bc22-7e3e-4a1f-8a40-cfcba5c38406 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.4473991 Nov 11 11:40:56.984348 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ecd7e6ec-a8d1-4935-8d51-5bde3064e11a req-166f0a99-8e17-4138-a07c-331c10746888 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2499003 Nov 11 11:40:56.986523 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f847c95e-0541-476b-9eb8-f478ff8b0484 req-59fb5563-4924-4de6-aeb6-8f50bda7704b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1550024 Nov 11 11:40:57.243676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2149ca07-49c8-44c1-8765-765da866d5e8 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:40:57.255558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:57.276621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Transition to ACTIVE for port object 2149ca07-49c8-44c1-8765-765da866d5e8 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:57.297695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07cfb499-8610-4771-932c-5e0e7182453f req-070cf09b-2d99-4261-9ba6-76004cd5bdfc tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:57.299338 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-07cfb499-8610-4771-932c-5e0e7182453f req-070cf09b-2d99-4261-9ba6-76004cd5bdfc tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 931 time: 0.1345096 Nov 11 11:40:57.322664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:57.332652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:57.398903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['d406b7f5-8b66-41f4-b933-ed75fdf4d06e'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:40:57.413335 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49', 'status': 'completed', 'code': 200} Nov 11 11:40:57.487934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Request body: {'port': {'device_id': '3ac7a6af-a9e4-4c03-894d-e9bad44fac64', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:40:57.515628 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'tag': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'status': 'completed', 'code': 200} Nov 11 11:40:57.577377 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-07cfb499-8610-4771-932c-5e0e7182453f req-b9022298-b9d1-4661-bca2-d0a202f078d5 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2712908 Nov 11 11:40:57.591626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Pushing event updated for resources: {'Port': ['ID=2149ca07-49c8-44c1-8765-765da866d5e8,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:57.614828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:57.627206 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9bc062e5-dbb2-4476-89ac-c047640fa352 req-7d4ff4fa-cf36-47e0-a70d-6f21104dfa4c service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1097 time: 0.1669424 Nov 11 11:40:57.767921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:57.796250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Attempting to bind port 2149ca07-49c8-44c1-8765-765da866d5e8 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:40:57.796787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Attempting to bind port 2149ca07-49c8-44c1-8765-765da866d5e8 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:40:57.797264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Attempting to bind port 2149ca07-49c8-44c1-8765-765da866d5e8 on network d616b076-b5a7-4954-b999-21a3b4c0cf2f {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:57.808590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc062e5-dbb2-4476-89ac-c047640fa352 req-30550072-fa43-4106-a844-69f716d785d7 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:57.810428 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9bc062e5-dbb2-4476-89ac-c047640fa352 req-30550072-fa43-4106-a844-69f716d785d7 service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1756704 Nov 11 11:40:57.854984 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-449b75d7-935f-4f21-9ff5-b04136b36477 req-f6f9b960-b011-4a87-b845-2060e1def982 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 1097 time: 0.3385298 Nov 11 11:40:57.924462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Port 2149ca07-49c8-44c1-8765-765da866d5e8 on network d616b076-b5a7-4954-b999-21a3b4c0cf2f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:40:57.924959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Attempting to bind port 2149ca07-49c8-44c1-8765-765da866d5e8 on network d616b076-b5a7-4954-b999-21a3b4c0cf2f {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:40:57.928154 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59148) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:57.963461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:58.015570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc062e5-dbb2-4476-89ac-c047640fa352 req-6e805027-79e3-4000-b7f7-b8e9372ece95 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:58.017546 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9bc062e5-dbb2-4476-89ac-c047640fa352 req-6e805027-79e3-4000-b7f7-b8e9372ece95 service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.2005377 Nov 11 11:40:58.023077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:40:58.023690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Checking segment: {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:40:58.024132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Bound using segment: {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:40:58.024631 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Bound port: 2149ca07-49c8-44c1-8765-765da866d5e8, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:40:58.025029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:58.028414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:40:58.033059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Usage tracker for resource:security_group_rule and tenant:fdbaeeda74ab421c9aa756ef7a718d1a is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:40:58.036714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:40:58.043544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:40:58.207944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:58.215593 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-583ff3b7-9bf3-403a-90c8-f595f492a871 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1097 time: 0.1405995 Nov 11 11:40:58.278989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] For port 2149ca07-49c8-44c1-8765-765da866d5e8, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:40:58.282190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] For port 2149ca07-49c8-44c1-8765-765da866d5e8, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=2149ca07-49c8-44c1-8765-765da866d5e8,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:40:58.289991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:58.308199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:58.320141 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-a94457f5-0220-4fbd-afdc-b7dd1bde6256 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=48b55264-0eab-46d7-abe8-ce455a036f49 HTTP/1.1" status: 200 len: 217 time: 0.0947793 Nov 11 11:40:58.361755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:58.395728 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a82d1684-472e-46c6-8559-50b4b5d45b88 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:58.412810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=459522ba-36a2-4fb3-9376-81d6ff4cc393,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:58.416135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:58.424863 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=fdbaeeda74ab421c9aa756ef7a718d1a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4927771 Nov 11 11:40:58.425140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59160) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:40:58.430647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0f6111-553e-48e7-8501-d598e9953991 req-18e72370-fbb3-4f7c-8fe2-5f034422e2a7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:58.432394 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dd0f6111-553e-48e7-8501-d598e9953991 req-18e72370-fbb3-4f7c-8fe2-5f034422e2a7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 944 time: 0.6374676 Nov 11 11:40:58.458542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-bb991cdd-27ab-4712-8442-aeb44583745b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:58.458542 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-bb991cdd-27ab-4712-8442-aeb44583745b service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.1239283 Nov 11 11:40:58.502987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449b75d7-935f-4f21-9ff5-b04136b36477 req-0775e9df-2c45-46ba-83bb-e079fae78b60 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:58.504602 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-449b75d7-935f-4f21-9ff5-b04136b36477 req-0775e9df-2c45-46ba-83bb-e079fae78b60 service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&shared=False HTTP/1.1" status: 200 len: 913 time: 0.6150317 Nov 11 11:40:58.575525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d06893f8-46ea-4947-b091-0d7b8cd24cf7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:58.578608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:58.580159 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] 10.222.0.60 "PUT /v2.0/ports/2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 200 len: 1093 time: 2.8327901 Nov 11 11:40:58.600411 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-9bf8b34f-e5f8-4343-a91c-0df94538204f service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1377256 Nov 11 11:40:58.642332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Pushing event updated for resources: {'Port': ['ID=2149ca07-49c8-44c1-8765-765da866d5e8,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:58.645711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:58.842936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d06893f8-46ea-4947-b091-0d7b8cd24cf7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:58.991534 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-a894ea90-7882-4491-aa97-2355acad924a service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3814800 Nov 11 11:40:59.032317 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dd0f6111-553e-48e7-8501-d598e9953991 req-4bc9daa3-300c-4f1a-879d-c12a29354ce1 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5810637 Nov 11 11:40:59.037035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d06893f8-46ea-4947-b091-0d7b8cd24cf7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:59.038727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e255b5-a674-4512-8e49-8e5092584a83 req-1d8f4c9c-3969-4488-b989-4a695475cc98 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:59.040569 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-11e255b5-a674-4512-8e49-8e5092584a83 req-1d8f4c9c-3969-4488-b989-4a695475cc98 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.8513598 Nov 11 11:40:59.048232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-127c0c32-f71c-4e3e-a23b-990ec7ed5bab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:59.119653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449b75d7-935f-4f21-9ff5-b04136b36477 req-ea5b3e26-c5a6-4d90-8df0-996622db39b1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:59.121383 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-449b75d7-935f-4f21-9ff5-b04136b36477 req-ea5b3e26-c5a6-4d90-8df0-996622db39b1 service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.6008961 Nov 11 11:40:59.122169 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d06893f8-46ea-4947-b091-0d7b8cd24cf7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=459522ba-36a2-4fb3-9376-81d6ff4cc393,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:40:59.129990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d06893f8-46ea-4947-b091-0d7b8cd24cf7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:40:59.142926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d06893f8-46ea-4947-b091-0d7b8cd24cf7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:59.147094 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d06893f8-46ea-4947-b091-0d7b8cd24cf7 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/459522ba-36a2-4fb3-9376-81d6ff4cc393 HTTP/1.1" status: 204 len: 168 time: 0.7209387 Nov 11 11:40:59.189490 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4e56738-3fe0-4a67-a83c-ecf6bb127a13 req-3749eeee-8061-4cae-a000-320df2e52447 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1854904 Nov 11 11:40:59.189834 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-11e255b5-a674-4512-8e49-8e5092584a83 req-f03e4752-54af-4f89-a40e-1f6cd16bf0a5 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1287515 Nov 11 11:40:59.267490 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-d61f9dea-65f7-4715-85a3-1c563ad55934 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1096 time: 0.3764005 Nov 11 11:40:59.409305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device d406b7f5-8b66-41f4-b933-ed75fdf4d06e up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:40:59.485851 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-52684b13-d80c-4d1a-a448-605e6173fe48 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 200 len: 217 time: 0.2145541 Nov 11 11:40:59.540845 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66d508f1-193d-4909-a4cd-59458908d0df', 'tag': '2149ca07-49c8-44c1-8765-765da866d5e8'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:40:59.560441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port d406b7f5-8b66-41f4-b933-ed75fdf4d06e completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:40:59.567335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port d406b7f5-8b66-41f4-b933-ed75fdf4d06e triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:40:59.567784 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:59.574226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e3d4fb61-8388-4546-8f10-81ccafd1477a {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:40:59.598447 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:59.650517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Transition to ACTIVE for port object e3d4fb61-8388-4546-8f10-81ccafd1477a will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:40:59.659368 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-910fce7c-aa63-4a27-a3bf-3e38c3ac15a8 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 1097 time: 0.4714148 Nov 11 11:40:59.661869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e27f7a-fd18-4308-b573-83741698ac6e req-dc8c9a61-9c01-4ada-a1d5-099c5a91a846 service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:59.663649 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-dc8c9a61-9c01-4ada-a1d5-099c5a91a846 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.1684096 Nov 11 11:40:59.801273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:59.827484 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-1f124c30-d886-4c5d-97cd-aa2940f04aea service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1527565 Nov 11 11:40:59.834441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:40:59.864336 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:40:59.873737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b73389a-432e-4ffb-af55-80fc4ac5fe39 req-2a98f2d9-0646-4193-8f01-8321c818e501 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:59.875985 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b73389a-432e-4ffb-af55-80fc4ac5fe39 req-2a98f2d9-0646-4193-8f01-8321c818e501 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.5477784 Nov 11 11:40:59.882075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb0e0470-fe80-48f3-a801-250c8e985b32 req-07f5e5b9-59b7-4bdc-9089-b67d184ab30f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:40:59.883866 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cb0e0470-fe80-48f3-a801-250c8e985b32 req-07f5e5b9-59b7-4bdc-9089-b67d184ab30f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 931 time: 0.5568614 Nov 11 11:40:59.921735 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-83a19612-9220-4f8d-9bf1-c41f86228337 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c HTTP/1.1" status: 200 len: 217 time: 0.2426858 Nov 11 11:40:59.967183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port d406b7f5-8b66-41f4-b933-ed75fdf4d06e, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,segment=NetworkSegment(f738a606-21d7-4c80-9a99-5e69bf9a03d2),segment_id=f738a606-21d7-4c80-9a99-5e69bf9a03d2)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:40:59.968701 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43d2e685-b837-4758-b0be-7f4308a961e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd406b7f5-8b66-41f4-b933-ed75fdf4d06e'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:00.058379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:00.061568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:00.148053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:00.152969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:00.240704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Pushing event updated for resources: {'Port': ['ID=e3d4fb61-8388-4546-8f10-81ccafd1477a,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:00.243820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.409s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:00.273987 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b73389a-432e-4ffb-af55-80fc4ac5fe39 req-9aa685c8-f514-473b-994e-afc48a93d110 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3866496 Nov 11 11:41:00.279268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-f9da79e7-aefb-4b2a-8b45-f3ddb8b7bda6 service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:00.280806 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-f9da79e7-aefb-4b2a-8b45-f3ddb8b7bda6 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.3309669 Nov 11 11:41:00.330409 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cb0e0470-fe80-48f3-a801-250c8e985b32 req-422af1f4-2204-40a9-beaf-6ca8e7c4aa3f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4354298 Nov 11 11:41:00.398641 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66d508f1-193d-4909-a4cd-59458908d0df', 'tag': '2149ca07-49c8-44c1-8765-765da866d5e8', 'status': 'completed', 'code': 200} Nov 11 11:41:00.400775 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-e1fb11b4-e7c6-4c41-a01e-8d8105360725 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5159020 Nov 11 11:41:00.407632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Attempting to bind port e3d4fb61-8388-4546-8f10-81ccafd1477a on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:41:00.408014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Attempting to bind port e3d4fb61-8388-4546-8f10-81ccafd1477a by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:41:00.408386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Attempting to bind port e3d4fb61-8388-4546-8f10-81ccafd1477a on network d616b076-b5a7-4954-b999-21a3b4c0cf2f {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:41:00.459195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Port e3d4fb61-8388-4546-8f10-81ccafd1477a on network d616b076-b5a7-4954-b999-21a3b4c0cf2f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:41:00.459838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Attempting to bind port e3d4fb61-8388-4546-8f10-81ccafd1477a on network d616b076-b5a7-4954-b999-21a3b4c0cf2f {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:41:00.605679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 40, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:41:00.606175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Checking segment: {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:41:00.606489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Bound using segment: {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:41:00.606988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Bound port: e3d4fb61-8388-4546-8f10-81ccafd1477a, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '908260cd-8125-4712-af58-79f96aa8b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1021, 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:41:00.607408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:00.653184 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43d2e685-b837-4758-b0be-7f4308a961e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd406b7f5-8b66-41f4-b933-ed75fdf4d06e', 'code': 200} Nov 11 11:41:00.959049 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-13e7be7e-beea-4520-8f29-1a7fe61eab6d service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.6458433 Nov 11 11:41:01.091173 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9f0216a5-b7a4-4058-b744-8d3099c6a06c service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 1098 time: 0.1031914 Nov 11 11:41:01.117902 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68e27f7a-fd18-4308-b573-83741698ac6e req-3214b719-97e8-4aab-99f7-12cdbbfacb97 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7054441 Nov 11 11:41:01.127761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:01.223879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] For port e3d4fb61-8388-4546-8f10-81ccafd1477a, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:41:01.253582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:01.258220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Usage tracker for resource:security_group_rule and tenant:dedb9d8cb3fd4377bd70dd2e2a35755f is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:01.261658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:01.268120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:01.298937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] For port e3d4fb61-8388-4546-8f10-81ccafd1477a, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:41:01.358446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:01.371805 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-b13bc61e-b3a1-4d7f-ba55-b560247303df service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3029077 Nov 11 11:41:01.378448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2fc9363-3007-4df7-9b51-51d4c3eb7029 req-300f4d1d-ae34-494a-9fe4-102cce67faf9 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:01.380204 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2fc9363-3007-4df7-9b51-51d4c3eb7029 req-300f4d1d-ae34-494a-9fe4-102cce67faf9 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.6907387 Nov 11 11:41:01.385527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:01.449775 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b52a52-0e1d-4c1f-a847-8766bea735fe req-5e4498e9-5a5e-4f40-ad39-c8e52335d749 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:01.451350 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-12b52a52-0e1d-4c1f-a847-8766bea735fe req-5e4498e9-5a5e-4f40-ad39-c8e52335d749 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.4964824 Nov 11 11:41:01.559214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:01.610908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:01.620309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:01.621811 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] 10.222.0.60 "PUT /v2.0/ports/e3d4fb61-8388-4546-8f10-81ccafd1477a HTTP/1.1" status: 200 len: 1093 time: 4.1493318 Nov 11 11:41:01.627502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-843cfbd1-8f38-4e71-9d3c-da8e0d274ebd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:01.659692 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-adbb03ed-461c-46f3-b768-6ae7785b97f6 req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5589521 Nov 11 11:41:01.667108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=62d6a834-be34-4865-a74e-33191e08f198,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:01.670429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:01.697535 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-288026df-81ed-4f62-b127-f9e78c172e4b req-bce08887-c8fb-4149-9c58-9ab289c38f19 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1096 time: 0.4823682 Nov 11 11:41:01.707219 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2fc9363-3007-4df7-9b51-51d4c3eb7029 req-d554bccb-78d8-4e1a-ba06-20ad0aa8841a tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2910783 Nov 11 11:41:01.716672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Pushing event updated for resources: {'Port': ['ID=e3d4fb61-8388-4546-8f10-81ccafd1477a,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:01.720766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.335s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:01.736658 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-12b52a52-0e1d-4c1f-a847-8766bea735fe req-5499c60c-67db-4756-84e6-866faafa5579 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2708395 Nov 11 11:41:01.764528 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01cc9cbb-91ad-4eaa-ba99-b319bf72caa4 req-07646b4c-a0a9-45c8-a54e-406359c9f088 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3822534 Nov 11 11:41:02.011721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c52f0d7-22bd-4408-96b9-05b961343a3e req-c21e67bb-e7ed-4285-bb8d-d88da4be3f34 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:02.013337 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8c52f0d7-22bd-4408-96b9-05b961343a3e req-c21e67bb-e7ed-4285-bb8d-d88da4be3f34 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1512685 Nov 11 11:41:02.024632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8ddff38-aa52-4d7f-b395-a7c314554509 req-c0ba5dd5-c84e-4fc1-a3ab-52926352c96d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:02.025876 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c8ddff38-aa52-4d7f-b395-a7c314554509 req-c0ba5dd5-c84e-4fc1-a3ab-52926352c96d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1283710 Nov 11 11:41:02.279609 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8c52f0d7-22bd-4408-96b9-05b961343a3e req-565654dc-6fe6-488c-96cf-77f5dd81fb32 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2525234 Nov 11 11:41:02.286584 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c8ddff38-aa52-4d7f-b395-a7c314554509 req-1e0b7248-18ef-4c6e-b0fb-2ca381906e6b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2357421 Nov 11 11:41:02.333965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288026df-81ed-4f62-b127-f9e78c172e4b req-53257a12-0551-4b37-a3dd-c28c709cd7c4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:02.335697 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-288026df-81ed-4f62-b127-f9e78c172e4b req-53257a12-0551-4b37-a3dd-c28c709cd7c4 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.2666268 Nov 11 11:41:02.339686 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3fce1bee-d9ee-41e2-a0d3-f26c4c67d2f7 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 1096 time: 0.2405782 Nov 11 11:41:02.416360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ac7a6af-a9e4-4c03-894d-e9bad44fac64', 'tag': 'e3d4fb61-8388-4546-8f10-81ccafd1477a'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:02.505698 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-288026df-81ed-4f62-b127-f9e78c172e4b req-c5217aca-f3a5-4f74-9d37-b62b4b7f8d69 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 200 len: 217 time: 0.1445677 Nov 11 11:41:02.521429 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-f8168cac-2816-4b49-b2ff-7e5fea34d8d7 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a HTTP/1.1" status: 200 len: 217 time: 0.1061950 Nov 11 11:41:02.556460 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ac7a6af-a9e4-4c03-894d-e9bad44fac64', 'tag': 'e3d4fb61-8388-4546-8f10-81ccafd1477a', 'status': 'completed', 'code': 200} Nov 11 11:41:02.989526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51db015d-70be-4167-9fe9-11d2d6ea7648 req-35caf133-9441-4de6-a11b-eb06ec72ea87 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:02.996091 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-51db015d-70be-4167-9fe9-11d2d6ea7648 req-35caf133-9441-4de6-a11b-eb06ec72ea87 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1596024 Nov 11 11:41:03.065145 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8398655c-c66f-4d41-8690-7ca24237c1b2 req-011fe239-ebeb-4c9e-bdff-2fd9ccddba4e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:03.066750 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8398655c-c66f-4d41-8690-7ca24237c1b2 req-011fe239-ebeb-4c9e-bdff-2fd9ccddba4e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.1573336 Nov 11 11:41:03.071884 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-51db015d-70be-4167-9fe9-11d2d6ea7648 req-3ce8d826-4ee7-4759-bbef-d45aad2f9f00 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749054 Nov 11 11:41:03.129346 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8398655c-c66f-4d41-8690-7ca24237c1b2 req-c7e6411d-43aa-4bb1-8249-5e522f6b48f8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0555637 Nov 11 11:41:03.608216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb263457-5cfa-4354-870f-9765ccadfaac req-d38fc237-916f-43eb-b724-b96c3d57076c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:03.609865 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bb263457-5cfa-4354-870f-9765ccadfaac req-d38fc237-916f-43eb-b724-b96c3d57076c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1167879 Nov 11 11:41:03.615983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726bc44d-12dc-4c46-a975-da62802edf7b req-9db0501f-9a1c-4e7b-bf1e-5e3fa93fcf3e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:03.617543 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-726bc44d-12dc-4c46-a975-da62802edf7b req-9db0501f-9a1c-4e7b-bf1e-5e3fa93fcf3e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1654506 Nov 11 11:41:03.694441 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bb263457-5cfa-4354-870f-9765ccadfaac req-fd3e3153-b3a9-4f9f-9547-c358f0929601 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0758297 Nov 11 11:41:03.701716 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-726bc44d-12dc-4c46-a975-da62802edf7b req-50f76e8a-61be-48a2-ba82-64ff57730f88 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676060 Nov 11 11:41:04.151311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59358) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:04.314157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:04.350679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:04.354979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Usage tracker for resource:security_group_rule and tenant:c6787ad62202442a9262068fc169395a is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:04.358230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:04.365749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:04.412508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:41:04.448576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:04.482006 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:04.491902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d251a023-a5e4-4879-b2b3-ec07a8430b18 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:04.540347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 59374) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:04.555031 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c6787ad62202442a9262068fc169395a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4017725 Nov 11 11:41:04.577593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5a99d2-9ccd-4c57-b28a-f5550a04ee8a req-fbabffc6-2344-4dd3-b360-f38eb7ed7fd5 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:04.582845 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=210a5b57-7d83-4b4f-a62e-fc04da65bba6,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:04.583003 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cf5a99d2-9ccd-4c57-b28a-f5550a04ee8a req-fbabffc6-2344-4dd3-b360-f38eb7ed7fd5 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.3761928 Nov 11 11:41:04.591900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:04.629937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:04.678047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:04.680889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8c39f5-8543-4cd3-8ec6-de882a76b5d3 req-7570c2c0-ec02-41db-92f2-3ea9262fa0b1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:04.682487 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0d8c39f5-8543-4cd3-8ec6-de882a76b5d3 req-7570c2c0-ec02-41db-92f2-3ea9262fa0b1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.4162452 Nov 11 11:41:04.727100 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cf5a99d2-9ccd-4c57-b28a-f5550a04ee8a req-8d19082c-cbfa-4035-9488-fb4ab57d22f7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323888 Nov 11 11:41:04.736809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b9533185-61ba-494e-89e2-988a87d98630 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:04.748421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '48b55264-0eab-46d7-abe8-ce455a036f49', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'port_id': '48b55264-0eab-46d7-abe8-ce455a036f49', 'mac_address': 'fa:16:3e:18:a5:54', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1022, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:41:04.783529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b9533185-61ba-494e-89e2-988a87d98630 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:04.795925 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0d8c39f5-8543-4cd3-8ec6-de882a76b5d3 req-7e17b5e2-0954-4ec3-987f-db497ac05f11 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1021531 Nov 11 11:41:04.831821 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:04.859685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 48b55264-0eab-46d7-abe8-ce455a036f49 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:41:04.965899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d22553c3-3f78-4058-8caf-35f6fe2f4a90 req-c874fee5-c19a-4e50-9f3d-c363f3f5ea59 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:04.969069 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d22553c3-3f78-4058-8caf-35f6fe2f4a90 req-c874fee5-c19a-4e50-9f3d-c363f3f5ea59 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1000795 Nov 11 11:41:04.976347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:05.014171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b9533185-61ba-494e-89e2-988a87d98630 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:05.016640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:05.018643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7060485c-e078-483e-bbca-e5a71a13a072 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:05.047227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-063c2fc0-aef5-468a-be9b-639a5270507f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:05.064121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9533185-61ba-494e-89e2-988a87d98630 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=210a5b57-7d83-4b4f-a62e-fc04da65bba6,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:05.071141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b9533185-61ba-494e-89e2-988a87d98630 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:05.090700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b9533185-61ba-494e-89e2-988a87d98630 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:05.091911 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b9533185-61ba-494e-89e2-988a87d98630 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/210a5b57-7d83-4b4f-a62e-fc04da65bba6 HTTP/1.1" status: 204 len: 168 time: 0.5416720 Nov 11 11:41:05.105092 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d22553c3-3f78-4058-8caf-35f6fe2f4a90 req-79026378-9779-4bbd-892a-4a874080d042 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1283615 Nov 11 11:41:05.108823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:05.112119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:05.138122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8018a9-8301-4c63-8725-a0459a43ddcf req-2781fe99-d977-4028-9c01-91caddeb360c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:05.140802 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa8018a9-8301-4c63-8725-a0459a43ddcf req-2781fe99-d977-4028-9c01-91caddeb360c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1645234 Nov 11 11:41:05.199775 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa8018a9-8301-4c63-8725-a0459a43ddcf req-dccb9304-f0f0-4423-b56e-bc8ad9f70611 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473139 Nov 11 11:41:05.632423 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 59390) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:05.652329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:05.685547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:05.690275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Usage tracker for resource:security_group_rule and tenant:608c4fa020d7485fbd8524d8306de272 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:05.693382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:05.699517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:05.778338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:05.815963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:05.826580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:05.910179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d65ea123-3c75-4430-9fd7-760ce65e4df9,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:05.922728 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59408) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:05.926544 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=608c4fa020d7485fbd8524d8306de272&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2928894 Nov 11 11:41:05.927975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:05.994193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-35dda9a0-fce3-4fc2-88a5-c945aca56562 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:06.014960 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd739ea2-591d-48f2-8472-4d6ac0132764 req-917bfdcd-f0ed-41be-97e8-907ad0a4a7bc tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:06.016597 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd739ea2-591d-48f2-8472-4d6ac0132764 req-917bfdcd-f0ed-41be-97e8-907ad0a4a7bc tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1512215 Nov 11 11:41:06.024254 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-35dda9a0-fce3-4fc2-88a5-c945aca56562 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:06.086650 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd739ea2-591d-48f2-8472-4d6ac0132764 req-62756e67-068c-4586-9789-4858e2445b7f tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623910 Nov 11 11:41:06.099297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95a167e-8a3c-4494-89f9-ee20dbb35ebf req-78ad82e1-ea2a-43a0-a495-a8a1fbfa0eca tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:06.100876 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d95a167e-8a3c-4494-89f9-ee20dbb35ebf req-78ad82e1-ea2a-43a0-a495-a8a1fbfa0eca tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.1443708 Nov 11 11:41:06.136048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-35dda9a0-fce3-4fc2-88a5-c945aca56562 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:06.141663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e9427927-5075-4364-bec3-9cd11aefb8de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:06.151766 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d95a167e-8a3c-4494-89f9-ee20dbb35ebf req-f29f930f-2233-4738-ae13-79aff1941b95 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445542 Nov 11 11:41:06.158124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35dda9a0-fce3-4fc2-88a5-c945aca56562 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d65ea123-3c75-4430-9fd7-760ce65e4df9,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:06.161113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-35dda9a0-fce3-4fc2-88a5-c945aca56562 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:06.173686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-35dda9a0-fce3-4fc2-88a5-c945aca56562 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:06.178081 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-35dda9a0-fce3-4fc2-88a5-c945aca56562 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/d65ea123-3c75-4430-9fd7-760ce65e4df9 HTTP/1.1" status: 204 len: 168 time: 0.2539508 Nov 11 11:41:06.412992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7d861b-7a57-4609-8d37-06578b98427e req-0434ecb1-9c77-4f15-baf4-96a23d65ec18 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:06.414559 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7d861b-7a57-4609-8d37-06578b98427e req-0434ecb1-9c77-4f15-baf4-96a23d65ec18 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1454895 Nov 11 11:41:06.459537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3c6dfa-4cbb-4913-ad88-9c21abcaac95 req-ebab3038-9d32-4178-ac39-c48de0668efe tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:06.461430 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc3c6dfa-4cbb-4913-ad88-9c21abcaac95 req-ebab3038-9d32-4178-ac39-c48de0668efe tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1322491 Nov 11 11:41:06.503290 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7d861b-7a57-4609-8d37-06578b98427e req-a417fae4-7ed8-4c9d-bd2a-7019658e9643 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0777576 Nov 11 11:41:06.525029 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc3c6dfa-4cbb-4913-ad88-9c21abcaac95 req-46d5287a-0314-468c-9773-f6daee0792f0 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539629 Nov 11 11:41:07.197391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288026df-81ed-4f62-b127-f9e78c172e4b req-ee75c613-7edb-4f9d-a87f-ed6c4d8c423b service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:07.198978 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-288026df-81ed-4f62-b127-f9e78c172e4b req-ee75c613-7edb-4f9d-a87f-ed6c4d8c423b service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.1271951 Nov 11 11:41:07.200377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-0fb31790-430c-473d-b15c-b6b16bbb476a service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:07.201773 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-0fb31790-430c-473d-b15c-b6b16bbb476a service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.0914166 Nov 11 11:41:07.313436 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-288026df-81ed-4f62-b127-f9e78c172e4b req-32d5035b-bbd4-4300-b53b-cf9d5e526eeb service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0963001 Nov 11 11:41:07.316075 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-58c220ef-c3cf-4851-ba35-4da2e1fac7c3 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0976627 Nov 11 11:41:07.452528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59456) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:07.611480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1892435231-network', 'tenant_id': 'ae132a17b438470b9d15c8bb6627a917'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:41:07.617146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:07.621495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Usage tracker for resource:network and tenant:ae132a17b438470b9d15c8bb6627a917 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:07.625751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:07.632535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:07.690485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Made reservation on behalf of ae132a17b438470b9d15c8bb6627a917 for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:41:07.696155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:07.709730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:07.713454 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-288026df-81ed-4f62-b127-f9e78c172e4b req-68ffb89e-6a1c-47d9-965c-edae7a507ffb service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3869441 Nov 11 11:41:07.743548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:07.747550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Usage tracker for resource:security_group_rule and tenant:ae132a17b438470b9d15c8bb6627a917 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:07.750482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:07.756455 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:07.758030 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-fce8f134-a352-4d3a-ac22-539416995153 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4083173 Nov 11 11:41:07.812111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183115f9-580f-496e-841f-7b7c7d21ff09 req-b481089a-64fc-48f6-8710-6b6bc2196ddc tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:07.813832 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-183115f9-580f-496e-841f-7b7c7d21ff09 req-b481089a-64fc-48f6-8710-6b6bc2196ddc tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.4398873 Nov 11 11:41:07.823954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480d96f9-0e40-4dce-96ba-634c8bb7cf33 req-8d120899-ef90-441c-95c4-bafea8c23dd8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:07.825513 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-480d96f9-0e40-4dce-96ba-634c8bb7cf33 req-8d120899-ef90-441c-95c4-bafea8c23dd8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.4433539 Nov 11 11:41:07.828514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:07.872600 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:07.876227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a6ee411c-9293-4fef-a945-4080ff6f817f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:07.909481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1010} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:41:07.915267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7fbf0e2-1c24-4ae9-92dd-65bae85e727b,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:07.919127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:07.926875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:07.927267 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Added segment 2a6aa7cf-bcea-4f0c-a38a-f91f464ae8b6 of type vlan for network d96f60da-8359-4d6c-b86e-3c6808992146 Nov 11 11:41:07.955668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:08.016538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:08.019933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:08.019933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:08.024864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dc89aecb-ba9f-4545-9c28-05cf6d8a8d3e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:08.100133 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-183115f9-580f-496e-841f-7b7c7d21ff09 req-e20c1e38-b84b-4af1-b58a-022ab6a57657 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2735212 Nov 11 11:41:08.116114 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-288026df-81ed-4f62-b127-f9e78c172e4b req-629b2b47-9dbb-4cff-acba-b917d299b143 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3926482 Nov 11 11:41:08.130196 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-480d96f9-0e40-4dce-96ba-634c8bb7cf33 req-1c5d5c03-591f-47ef-bec7-e52b741c07fd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2478099 Nov 11 11:41:08.145775 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-0f0d9514-ee34-4898-9909-ce4bf68288fa service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3587134 Nov 11 11:41:08.155827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Pushing event updated for resources: {'Network': ['ID=d96f60da-8359-4d6c-b86e-3c6808992146,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:08.173118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network d96f60da-8359-4d6c-b86e-3c6808992146 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:41:08.178014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:08.208914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 59476) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:08.209441 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.7555892 Nov 11 11:41:08.215990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Request body: {'subnet': {'network_id': 'd96f60da-8359-4d6c-b86e-3c6808992146', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1892435231-subnet', 'tenant_id': 'ae132a17b438470b9d15c8bb6627a917', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:41:08.225305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:08.230463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Usage tracker for resource:subnet and tenant:ae132a17b438470b9d15c8bb6627a917 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:08.234663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:08.242580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:08.326198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['48b55264-0eab-46d7-abe8-ce455a036f49'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:41:08.368122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Made reservation on behalf of ae132a17b438470b9d15c8bb6627a917 for: {'subnet': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:41:08.372835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Notify callbacks [] for subnet, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:08.785505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bd4e44-e70d-406d-8124-c01550982cad req-99744e3b-74db-416f-970a-37636f277d38 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:08.787098 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-84bd4e44-e70d-406d-8124-c01550982cad req-99744e3b-74db-416f-970a-37636f277d38 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.5149214 Nov 11 11:41:08.791458 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-23f62975-5ca1-4803-8111-8d857a4a076f service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 1096 time: 0.4727609 Nov 11 11:41:08.917546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8945be6-bc98-47bc-8411-6935ca35aa78 req-68250f7f-2582-4f99-971b-be74f61e94c0 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:08.919178 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c8945be6-bc98-47bc-8411-6935ca35aa78 req-68250f7f-2582-4f99-971b-be74f61e94c0 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.2510912 Nov 11 11:41:08.924782 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-84bd4e44-e70d-406d-8124-c01550982cad req-a3d2b9fe-d7dd-49c3-a3ec-4ac49acb032c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1302447 Nov 11 11:41:09.006561 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c8945be6-bc98-47bc-8411-6935ca35aa78 req-99b5cc04-9a72-4fe1-b6c0-dfe0f4a7845b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787635 Nov 11 11:41:09.041435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:09.045867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1d886de0-37cd-48b5-bc9f-6fab03c199d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:09.113092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Pushing event updated for resources: {'Subnet': ['ID=686de8d6-9d14-4c91-b935-fadb3938297c,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:09.117038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:09.139716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Checking segment: {'id': '2a6aa7cf-bcea-4f0c-a38a-f91f464ae8b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'd96f60da-8359-4d6c-b86e-3c6808992146'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:41:09.140112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Network hostable DHCP agents. Network: d96f60da-8359-4d6c-b86e-3c6808992146, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88329) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:41:09.200978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Network d96f60da-8359-4d6c-b86e-3c6808992146 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88329) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:41:09.243193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, d96f60da-8359-4d6c-b86e-3c6808992146) {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:41:09.254651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdc89218-9c12-4ddb-bd28-82a4a8a4c441 None None] Network d96f60da-8359-4d6c-b86e-3c6808992146 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:41:09.258916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:09.259768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:09.379456 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.1693645 Nov 11 11:41:09.440214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38929781-becc-4150-aa2a-ef86026a6739 req-c46604c1-a73e-42f2-acf3-c2ebaaa2b742 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:09.443911 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-38929781-becc-4150-aa2a-ef86026a6739 req-c46604c1-a73e-42f2-acf3-c2ebaaa2b742 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1595600 Nov 11 11:41:09.471504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a82eec6-937d-47d3-ab6c-ae574dec95cc req-75d990c2-c07d-4e42-a8ca-21cd20f76827 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:09.473099 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1a82eec6-937d-47d3-ab6c-ae574dec95cc req-75d990c2-c07d-4e42-a8ca-21cd20f76827 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.1527970 Nov 11 11:41:09.511951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a878c7c8-8e56-4990-b322-b40fe7357140 None None] Network d96f60da-8359-4d6c-b86e-3c6808992146 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:41:09.554448 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-38929781-becc-4150-aa2a-ef86026a6739 req-c8131035-686b-400d-b7b2-b526a344b951 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1054146 Nov 11 11:41:09.567025 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1a82eec6-937d-47d3-ab6c-ae574dec95cc req-65fc5a5c-d4fd-412e-910b-5f63ebddbc59 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0849841 Nov 11 11:41:10.007221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c70a015b-25a2-46e4-90b5-f1eed6bdcb44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:10.144036 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc57e210-e0ff-489e-b9ab-850cc79747f5 req-69fb2033-cf3a-4a31-b59b-05b628771346 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:10.147638 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc57e210-e0ff-489e-b9ab-850cc79747f5 req-69fb2033-cf3a-4a31-b59b-05b628771346 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.0874989 Nov 11 11:41:10.265124 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc57e210-e0ff-489e-b9ab-850cc79747f5 req-d9ad5108-c217-4e86-868e-f5728dd769f7 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0738559 Nov 11 11:41:10.272245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071a92d8-a4f6-494d-9d58-7ac608970424 req-43aad349-0331-4dac-ad0f-ee1a62aa5779 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:10.273829 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-071a92d8-a4f6-494d-9d58-7ac608970424 req-43aad349-0331-4dac-ad0f-ee1a62aa5779 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1250393 Nov 11 11:41:10.436764 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-071a92d8-a4f6-494d-9d58-7ac608970424 req-e5a491d9-d7b2-4f17-a07e-179790ce1c8d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1303151 Nov 11 11:41:10.462949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-9535998e-ee21-4e57-ae7c-3a772579c4e6 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:10.462949 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-9535998e-ee21-4e57-ae7c-3a772579c4e6 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.1852527 Nov 11 11:41:10.507264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 59526) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:10.513225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-614638044-network', 'tenant_id': 'b1d5cec0bec340a987ba82c49230bc47'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:41:10.518434 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:10.522616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Usage tracker for resource:network and tenant:b1d5cec0bec340a987ba82c49230bc47 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:10.525907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:10.532715 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:10.607378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Made reservation on behalf of b1d5cec0bec340a987ba82c49230bc47 for: {'network': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:41:10.612290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:10.626647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:10.663430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:10.667623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Usage tracker for resource:security_group_rule and tenant:b1d5cec0bec340a987ba82c49230bc47 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:10.670653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:10.678743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:10.868350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:10.901640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff16e2c-8dc4-47e5-adeb-55db73f600cd req-ef1ff4a1-cb4e-4e6a-9d81-6f367753d548 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:10.903271 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4ff16e2c-8dc4-47e5-adeb-55db73f600cd req-ef1ff4a1-cb4e-4e6a-9d81-6f367753d548 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.2017477 Nov 11 11:41:10.910810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea4a8ba-c445-4dae-b03f-2c815de645fb req-fe861bcd-e8a6-4258-bf88-3b7515810db9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:10.912364 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7ea4a8ba-c445-4dae-b03f-2c815de645fb req-fe861bcd-e8a6-4258-bf88-3b7515810db9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.1627238 Nov 11 11:41:10.934734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:10.955624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:11.005673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1047} {{(pid=88329) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:41:11.029933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64a01972-3112-4627-81ec-526afd778409,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:11.048620 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7ea4a8ba-c445-4dae-b03f-2c815de645fb req-70d1646d-ac15-4470-bd9e-131cb4388587 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1174345 Nov 11 11:41:11.049694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:11.050174 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Added segment ddf57698-4593-4a1e-8a3e-eb5a836e5195 of type vlan for network 051d67c1-8621-4b80-95a5-4d8130e0d888 Nov 11 11:41:11.055196 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4ff16e2c-8dc4-47e5-adeb-55db73f600cd req-8646be22-81c9-416f-9da3-a4052759f0cc tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1397700 Nov 11 11:41:11.058435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.058829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.059244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.059631 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.060030 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.060364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.060742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.061116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.061519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.061890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.062347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.066720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:11.104130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:11.227189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:11.228627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:11.229267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:11.234713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:11.286689 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:11.444466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Pushing event updated for resources: {'Network': ['ID=051d67c1-8621-4b80-95a5-4d8130e0d888,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:11.453414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:11.454247 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-f2bf7cb8-26fa-4170-91b3-6c45b9181af6 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a HTTP/1.1" status: 200 len: 217 time: 0.1255138 Nov 11 11:41:11.455644 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9473009 Nov 11 11:41:11.456487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 051d67c1-8621-4b80-95a5-4d8130e0d888 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:41:11.459232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59542) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:11.466851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Request body: {'subnet': {'network_id': '051d67c1-8621-4b80-95a5-4d8130e0d888', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-614638044-subnet', 'tenant_id': 'b1d5cec0bec340a987ba82c49230bc47', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:41:11.472728 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:11.476926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Usage tracker for resource:subnet and tenant:b1d5cec0bec340a987ba82c49230bc47 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:11.480213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:11.488069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:11.512475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3b796a2-4d15-4abf-9861-a4b15571e5b5 req-81872d3b-c919-402c-8bdc-ee3e4d5a0011 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:11.514283 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f3b796a2-4d15-4abf-9861-a4b15571e5b5 req-81872d3b-c919-402c-8bdc-ee3e4d5a0011 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1126125 Nov 11 11:41:11.535983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Made reservation on behalf of b1d5cec0bec340a987ba82c49230bc47 for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:41:11.540826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036852136936'] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:11.603913 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f3b796a2-4d15-4abf-9861-a4b15571e5b5 req-b53dc90d-8283-4179-8cfa-28206862e042 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0791452 Nov 11 11:41:11.738040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a548f989-3142-4e3c-bec2-44c3e2e22599 req-2090bb63-b8a8-4a98-ac01-1a3b7363ec5a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:11.738973 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a548f989-3142-4e3c-bec2-44c3e2e22599 req-2090bb63-b8a8-4a98-ac01-1a3b7363ec5a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.0869334 Nov 11 11:41:11.791751 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a548f989-3142-4e3c-bec2-44c3e2e22599 req-2007ae72-9b1f-4fc3-abe9-0a85e13ff45c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457220 Nov 11 11:41:11.846894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created--9223372036852097580', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036852136951'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:11.851493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c87c821b-a7e0-4f81-84b5-25ced8768ce6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:11.928032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Pushing event updated for resources: {'Subnet': ['ID=8efc991d-1af9-46d3-b626-ba7a22473ffc,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:11.944752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.945166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.945567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.945962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.946355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.946745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.947132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.947547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.947932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.948315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.948699 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:11.953656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:11.957075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Checking segment: {'id': 'ddf57698-4593-4a1e-8a3e-eb5a836e5195', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '051d67c1-8621-4b80-95a5-4d8130e0d888'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:41:11.957474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Network hostable DHCP agents. Network: 051d67c1-8621-4b80-95a5-4d8130e0d888, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:41:12.038545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Network 051d67c1-8621-4b80-95a5-4d8130e0d888 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:41:12.095614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 051d67c1-8621-4b80-95a5-4d8130e0d888) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:41:12.099675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:12.100387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:12.105220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-533beadf-d701-4b33-be45-2b0d7bcb1352 None None] Network 051d67c1-8621-4b80-95a5-4d8130e0d888 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:41:12.159053 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-36ca3b4e-bef0-4027-9642-05268faaf73b admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6902256 Nov 11 11:41:12.346965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df168d09-b18d-41bf-9a25-5efa28138029 None None] Network 051d67c1-8621-4b80-95a5-4d8130e0d888 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:41:12.379991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05da533-ae16-4937-9745-3a59dec8776a req-d71f031d-813d-438e-85ea-0d2c01f5d93c tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:12.381609 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d05da533-ae16-4937-9745-3a59dec8776a req-d71f031d-813d-438e-85ea-0d2c01f5d93c tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1790810 Nov 11 11:41:12.390080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1e7eb5-5931-4e72-aba7-df96a6a747ba req-889b5922-acf2-48f9-9c59-bafafc77fd23 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:12.393158 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2f1e7eb5-5931-4e72-aba7-df96a6a747ba req-889b5922-acf2-48f9-9c59-bafafc77fd23 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.1483717 Nov 11 11:41:12.470673 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2f1e7eb5-5931-4e72-aba7-df96a6a747ba req-0cb02955-b06a-40c4-8d26-acd33d4198e6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0593865 Nov 11 11:41:12.492283 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d05da533-ae16-4937-9745-3a59dec8776a req-56c26f52-973f-4631-91b6-b162dac02287 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0976167 Nov 11 11:41:12.809119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-8e2bba12-5c19-416b-a8ca-8310b8f85e88 service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:12.810663 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-8e2bba12-5c19-416b-a8ca-8310b8f85e88 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.1128690 Nov 11 11:41:12.873802 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-1c094610-cfa4-49ff-95bb-5d75e7df93fe service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0524879 Nov 11 11:41:12.886187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b059843-b168-4c5a-b51c-106e5ae029a1 req-7c220806-b136-4382-9c38-c0d0bfb5b758 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:12.887737 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b059843-b168-4c5a-b51c-106e5ae029a1 req-7c220806-b136-4382-9c38-c0d0bfb5b758 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1526740 Nov 11 11:41:13.105237 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b059843-b168-4c5a-b51c-106e5ae029a1 req-fc42d8a1-716d-4c9e-9dff-cb31e35d7c7c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1924989 Nov 11 11:41:13.149083 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-d423d268-4896-4d80-9698-314874768137 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2515683 Nov 11 11:41:13.150833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9ec40a-6c57-475b-99ea-d169e136fb77 req-b3b4a3a5-4886-4c51-af7f-04c3ff2ee829 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:13.152443 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5f9ec40a-6c57-475b-99ea-d169e136fb77 req-b3b4a3a5-4886-4c51-af7f-04c3ff2ee829 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.2221189 Nov 11 11:41:13.304065 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5f9ec40a-6c57-475b-99ea-d169e136fb77 req-8d3adab7-b1c9-40ae-bebb-fae374cf46c8 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1269071 Nov 11 11:41:13.329074 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7691177-346a-44ca-8bb4-bd9a5d73779e req-cba1716a-afb9-4a5b-98c8-8e9559218c19 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1741772 Nov 11 11:41:13.452316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4d7ccbe4-18e3-4c07-a63e-823053176bba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:13.486474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:13.970883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d6433c1-7622-4529-b0ec-cb298ee9f083 req-d16adb25-3110-4df7-ad98-22dabaa3a4dd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:13.972444 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6d6433c1-7622-4529-b0ec-cb298ee9f083 req-d16adb25-3110-4df7-ad98-22dabaa3a4dd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.3268104 Nov 11 11:41:13.983384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79360c44-73e3-4269-bfab-95f1138af487 req-a171105c-a16a-46d7-b475-8370659db79d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:13.984938 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-79360c44-73e3-4269-bfab-95f1138af487 req-a171105c-a16a-46d7-b475-8370659db79d tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.3044536 Nov 11 11:41:14.061792 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6d6433c1-7622-4529-b0ec-cb298ee9f083 req-03ce4448-03a4-4a51-b990-8c1b68b99491 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0758300 Nov 11 11:41:14.066622 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-79360c44-73e3-4269-bfab-95f1138af487 req-c519db25-bcbb-495a-a241-63c442ca648b tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642319 Nov 11 11:41:14.316034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1d428f-6c88-4502-a777-643d3abbec01 req-5f4517f6-30cd-4301-af77-0526c6f7780b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:14.317598 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ca1d428f-6c88-4502-a777-643d3abbec01 req-5f4517f6-30cd-4301-af77-0526c6f7780b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.0853279 Nov 11 11:41:14.367022 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ca1d428f-6c88-4502-a777-643d3abbec01 req-7e94aa21-b802-4272-994a-146a8d38c951 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430651 Nov 11 11:41:14.512735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b553eb4-4f46-44bb-b6a1-05f04abf4323 req-f3003b6d-e309-4196-91fd-f12657a0323b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:14.512735 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b553eb4-4f46-44bb-b6a1-05f04abf4323 req-f3003b6d-e309-4196-91fd-f12657a0323b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.0814276 Nov 11 11:41:14.563293 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b553eb4-4f46-44bb-b6a1-05f04abf4323 req-b7b3b150-52d4-4b9b-9398-33ba37fa773b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451310 Nov 11 11:41:14.618434 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:15.345508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139886c8-e17c-4004-a520-ca8feff9cfb3 req-51459980-e848-4cf1-9624-8e2341077fe7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:15.347091 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-139886c8-e17c-4004-a520-ca8feff9cfb3 req-51459980-e848-4cf1-9624-8e2341077fe7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.1504390 Nov 11 11:41:15.353753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241bc64f-4688-43be-83e7-7019c02114ff req-ff9eb3e0-0bed-40b9-9033-6df3f1cec358 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:15.355266 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-241bc64f-4688-43be-83e7-7019c02114ff req-ff9eb3e0-0bed-40b9-9033-6df3f1cec358 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1571748 Nov 11 11:41:15.435818 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-139886c8-e17c-4004-a520-ca8feff9cfb3 req-4f447715-6e67-4aba-8c9b-883430708dbd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0794363 Nov 11 11:41:15.438517 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-241bc64f-4688-43be-83e7-7019c02114ff req-ef22ff79-47f6-4217-aee4-207c60841acf tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677285 Nov 11 11:41:15.628415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f594f2-f338-4b83-b16a-ce0f487ea85b req-d684043a-45be-4a14-8432-9eb8d4352045 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:15.629986 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-16f594f2-f338-4b83-b16a-ce0f487ea85b req-d684043a-45be-4a14-8432-9eb8d4352045 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.0818553 Nov 11 11:41:15.679002 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-16f594f2-f338-4b83-b16a-ce0f487ea85b req-7a7f41f7-6e64-4e5a-96f4-eeadeaeab569 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428581 Nov 11 11:41:15.770680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f80ead-8275-4fc9-9032-6734fc82c690 req-3c7b7893-f7e2-4be4-b6b2-ab03a66cd7d1 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:15.772274 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e8f80ead-8275-4fc9-9032-6734fc82c690 req-3c7b7893-f7e2-4be4-b6b2-ab03a66cd7d1 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.0841250 Nov 11 11:41:15.820158 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e8f80ead-8275-4fc9-9032-6734fc82c690 req-e9c98521-4334-4728-b46a-60ae92bd9c8a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418260 Nov 11 11:41:16.750603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0301c69d-0abf-47e7-ad67-921e0a32718e req-298dbd33-e49d-499f-b364-a95e8db4b83a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:16.752202 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0301c69d-0abf-47e7-ad67-921e0a32718e req-298dbd33-e49d-499f-b364-a95e8db4b83a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.1492620 Nov 11 11:41:16.758983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b14990-9c9d-47b3-b6e3-c15333f730de req-c3c9a7e2-4fce-43b4-b46b-201f96c23990 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:16.760476 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-69b14990-9c9d-47b3-b6e3-c15333f730de req-c3c9a7e2-4fce-43b4-b46b-201f96c23990 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1554823 Nov 11 11:41:16.838440 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0301c69d-0abf-47e7-ad67-921e0a32718e req-8c1aeb2a-f38a-44e6-bd9d-c41609cf1754 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0768478 Nov 11 11:41:16.840880 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-69b14990-9c9d-47b3-b6e3-c15333f730de req-399119cb-66a3-4fab-8ba8-62c7800f5290 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653641 Nov 11 11:41:17.107606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba776e09-8b1e-4f41-b1eb-eede3626a186 req-9d832c6f-991a-418e-af21-208232c5da1e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:17.109732 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba776e09-8b1e-4f41-b1eb-eede3626a186 req-9d832c6f-991a-418e-af21-208232c5da1e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1179461 Nov 11 11:41:17.115907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce2e0b5-ccd0-41a3-b415-d3f35d7cc5df req-37e2e4fe-06a7-429d-84f9-27bd4f7f4742 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:17.117395 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6ce2e0b5-ccd0-41a3-b415-d3f35d7cc5df req-37e2e4fe-06a7-429d-84f9-27bd4f7f4742 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1609015 Nov 11 11:41:17.196765 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba776e09-8b1e-4f41-b1eb-eede3626a186 req-f2c1dea1-995e-46c0-9f4f-f7b499891f86 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783620 Nov 11 11:41:17.199363 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6ce2e0b5-ccd0-41a3-b415-d3f35d7cc5df req-99f3a892-fa24-4daf-8715-5adc81082d0d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0658278 Nov 11 11:41:17.554781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:41:18.113921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb1c4a7a-845e-4386-8995-98cb16e49826 req-32702d11-cb5f-44b1-a71e-418f80b9a2d2 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:18.117347 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bb1c4a7a-845e-4386-8995-98cb16e49826 req-32702d11-cb5f-44b1-a71e-418f80b9a2d2 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1497076 Nov 11 11:41:18.123345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7755c86-9ddf-4846-8e2b-62da7a5ed0d4 req-e13d33eb-d961-4ac0-a5cd-6830c71f4bfe tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:18.124801 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c7755c86-9ddf-4846-8e2b-62da7a5ed0d4 req-e13d33eb-d961-4ac0-a5cd-6830c71f4bfe tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.1223705 Nov 11 11:41:18.205857 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bb1c4a7a-845e-4386-8995-98cb16e49826 req-c0d2c475-551a-4c94-91bf-0b73bb3f0037 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795045 Nov 11 11:41:18.208641 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c7755c86-9ddf-4846-8e2b-62da7a5ed0d4 req-a0387b77-ef19-4860-b6d3-ce9b372c4838 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678589 Nov 11 11:41:18.484200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e61bad5-9862-4842-b7c9-787a68869cc3 req-3cd66cb9-82c1-4ef5-8d83-dceeb9397c1f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:18.486229 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e61bad5-9862-4842-b7c9-787a68869cc3 req-3cd66cb9-82c1-4ef5-8d83-dceeb9397c1f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1562862 Nov 11 11:41:18.492029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8f8951-cfe0-4ea3-a066-81edf337fa2b req-dcfa7fb6-a6cb-4ae5-af65-84b03fda73cb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:18.493491 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7e8f8951-cfe0-4ea3-a066-81edf337fa2b req-dcfa7fb6-a6cb-4ae5-af65-84b03fda73cb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1182683 Nov 11 11:41:18.573533 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e61bad5-9862-4842-b7c9-787a68869cc3 req-c8ffc2c2-9b2b-447e-9baa-2fa52b26dc50 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0789979 Nov 11 11:41:18.577328 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7e8f8951-cfe0-4ea3-a066-81edf337fa2b req-1da23d83-9c99-4296-805f-3ebb597cc21b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659273 Nov 11 11:41:19.486941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31dfcab8-9f74-4bba-8320-fc946cac6ecb req-dbb6795a-beed-4b6e-a0e9-d09f23685c95 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:19.489262 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-31dfcab8-9f74-4bba-8320-fc946cac6ecb req-dbb6795a-beed-4b6e-a0e9-d09f23685c95 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.1183283 Nov 11 11:41:19.495298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b750bb-e1a1-49c2-9907-44e761186cdd req-abc12e8c-9c62-491c-a336-575090df871b tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:19.496795 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b8b750bb-e1a1-49c2-9907-44e761186cdd req-abc12e8c-9c62-491c-a336-575090df871b tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1630523 Nov 11 11:41:19.579318 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-31dfcab8-9f74-4bba-8320-fc946cac6ecb req-7a8b12d3-db89-4593-9903-330b93cd2d4f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0803030 Nov 11 11:41:19.581560 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b8b750bb-e1a1-49c2-9907-44e761186cdd req-da82a16a-f095-4289-ab5e-4ec3bfa874a0 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689490 Nov 11 11:41:19.582704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 2149ca07-49c8-44c1-8765-765da866d5e8 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:41:19.634024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:41:19.865290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d518ce50-03a5-4fda-8946-b2c962def5a5 req-75e677d9-a7b7-44ac-bbb7-bbb3495f71b9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:19.866856 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d518ce50-03a5-4fda-8946-b2c962def5a5 req-75e677d9-a7b7-44ac-bbb7-bbb3495f71b9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.1528740 Nov 11 11:41:19.878642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a825b9a-a9cc-47fb-aa8c-42607fd4ea1f req-06866dce-5724-45aa-b3cb-ad569861cbac tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:19.880260 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4a825b9a-a9cc-47fb-aa8c-42607fd4ea1f req-06866dce-5724-45aa-b3cb-ad569861cbac tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1318593 Nov 11 11:41:19.948799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 2149ca07-49c8-44c1-8765-765da866d5e8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=2149ca07-49c8-44c1-8765-765da866d5e8,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:19.965442 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d518ce50-03a5-4fda-8946-b2c962def5a5 req-3d052ef5-93a1-455b-bced-0f4ddaacbca9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0840745 Nov 11 11:41:19.966633 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '2149ca07-49c8-44c1-8765-765da866d5e8', 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f', 'port_id': '2149ca07-49c8-44c1-8765-765da866d5e8', 'mac_address': 'fa:16:3e:e1:74:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1021, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c0ace514-c466-40d3-9d56-40ff46839783', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:41:19.967798 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4a825b9a-a9cc-47fb-aa8c-42607fd4ea1f req-ae4b9dda-8e61-4539-b90d-287db46d9ee2 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717645 Nov 11 11:41:19.998107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 48b55264-0eab-46d7-abe8-ce455a036f49 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:41:20.010654 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 48b55264-0eab-46d7-abe8-ce455a036f49 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:41:20.011080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:20.074713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:20.101659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2149ca07-49c8-44c1-8765-765da866d5e8 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:41:20.148463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 2149ca07-49c8-44c1-8765-765da866d5e8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=2149ca07-49c8-44c1-8765-765da866d5e8,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:20.176181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:20.189672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:20.193239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:20.247672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:20.273331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:20.282494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=2149ca07-49c8-44c1-8765-765da866d5e8,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:20.295815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.298231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.298931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.299617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.300965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.300965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.301208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.302024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.302397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.303284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.304174 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:41:20.309425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:20.310832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:20.313440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3f06f218-ede7-46c8-98e1-075ae40f83c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:20.350153 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49', 'code': 200} Nov 11 11:41:20.388663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:20.392022 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:20.864339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203dac07-c550-494b-aca2-23bf068694b0 req-e0e8157d-1a69-43ba-b8d9-18d59777266a tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:20.865917 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-203dac07-c550-494b-aca2-23bf068694b0 req-e0e8157d-1a69-43ba-b8d9-18d59777266a tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1514170 Nov 11 11:41:20.872618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7e3250-a1d1-4d2f-92f6-afebe29f07ef req-0c809cdc-bc6e-47c6-8f38-9158bee2d10d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:20.874315 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8a7e3250-a1d1-4d2f-92f6-afebe29f07ef req-0c809cdc-bc6e-47c6-8f38-9158bee2d10d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1248395 Nov 11 11:41:20.951463 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-203dac07-c550-494b-aca2-23bf068694b0 req-88eaffd1-42ee-4562-a39d-89b0b916a27f tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755587 Nov 11 11:41:20.956862 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8a7e3250-a1d1-4d2f-92f6-afebe29f07ef req-63a2e16b-7ad0-4250-9db8-24a8367a1525 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0668368 Nov 11 11:41:21.221471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990462a8-7578-4d5e-8e20-e45f0d5c4f11 req-de9e2af1-6416-4d7a-8cc1-62c2a9fb4f39 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:21.221471 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-990462a8-7578-4d5e-8e20-e45f0d5c4f11 req-de9e2af1-6416-4d7a-8cc1-62c2a9fb4f39 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.0936279 Nov 11 11:41:21.319812 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-990462a8-7578-4d5e-8e20-e45f0d5c4f11 req-ece50769-b01d-42d9-9cdc-743c3790b45b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0970464 Nov 11 11:41:21.350744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e878728-060e-4b6a-b70c-4dc06ff7085d req-136813de-98bc-4439-83ce-cd0e63ace815 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:21.352392 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8e878728-060e-4b6a-b70c-4dc06ff7085d req-136813de-98bc-4439-83ce-cd0e63ace815 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1064553 Nov 11 11:41:21.401777 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8e878728-060e-4b6a-b70c-4dc06ff7085d req-bea828c9-c10d-4366-ab56-dbb26c672cb0 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430613 Nov 11 11:41:22.251927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce747e4-764c-4a7d-846c-58656d39249b req-4840bed5-bebe-4c4d-983e-8ab351f8c18c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:22.253502 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6ce747e4-764c-4a7d-846c-58656d39249b req-4840bed5-bebe-4c4d-983e-8ab351f8c18c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0901973 Nov 11 11:41:22.302257 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6ce747e4-764c-4a7d-846c-58656d39249b req-2a258fc4-995c-405d-a200-4b7b54e1fe21 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427141 Nov 11 11:41:22.527615 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0109b71-a935-4a74-b722-1fbf12e90093 req-981dcaab-0fb5-451c-b5ad-761608a21d4d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:22.529418 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e0109b71-a935-4a74-b722-1fbf12e90093 req-981dcaab-0fb5-451c-b5ad-761608a21d4d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.0844724 Nov 11 11:41:22.632947 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e0109b71-a935-4a74-b722-1fbf12e90093 req-b0286a70-c612-41ec-9a06-5d0ec033cc1f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0648324 Nov 11 11:41:22.658047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e796fe-27f2-4853-899d-fbd73b2ac5b1 req-1c60817c-6a43-4319-a68a-6b490dfe9fcf tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:22.659312 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-71e796fe-27f2-4853-899d-fbd73b2ac5b1 req-1c60817c-6a43-4319-a68a-6b490dfe9fcf tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1259613 Nov 11 11:41:22.709150 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-71e796fe-27f2-4853-899d-fbd73b2ac5b1 req-aa14e7f3-a91e-4a02-92e3-47a64ad498ed tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437386 Nov 11 11:41:23.521508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76014809-037f-4157-a1c9-94fa17e75568 req-867b174f-cfa4-489a-8ba8-62a41b78cef5 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:23.523296 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-76014809-037f-4157-a1c9-94fa17e75568 req-867b174f-cfa4-489a-8ba8-62a41b78cef5 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0837960 Nov 11 11:41:23.573079 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-76014809-037f-4157-a1c9-94fa17e75568 req-130f55a2-4e5b-4edc-ad24-c0e97689fd10 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430079 Nov 11 11:41:23.854462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805b0dd9-d48c-495e-a8ca-734240575291 req-a8248269-b7ae-4ed2-86b6-5fc3f87a19c5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:23.856159 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-805b0dd9-d48c-495e-a8ca-734240575291 req-a8248269-b7ae-4ed2-86b6-5fc3f87a19c5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 944 time: 0.0978653 Nov 11 11:41:23.952932 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-805b0dd9-d48c-495e-a8ca-734240575291 req-a465b1a4-e5b3-4e8e-8bfc-78e1e8347918 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0618894 Nov 11 11:41:23.978521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce207836-6f7a-4726-8d3c-626f8afdd4c6 req-e3bb1ac8-7919-4bb2-8786-49a10c9a49bb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:23.980132 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ce207836-6f7a-4726-8d3c-626f8afdd4c6 req-e3bb1ac8-7919-4bb2-8786-49a10c9a49bb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1329873 Nov 11 11:41:24.031385 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ce207836-6f7a-4726-8d3c-626f8afdd4c6 req-b2c0ab13-8fe0-4104-95cb-871d51c79642 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451896 Nov 11 11:41:24.379756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 4883439e-6709-46bc-b7b3-a1dfa2128b0c details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:41:24.507818 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9724f2a5-3a3d-46e6-991b-ae4fa5101284 req-f9bc8c81-b6fd-453d-9bcf-f667d4852cb7 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1099 time: 0.0944059 Nov 11 11:41:24.526938 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 4883439e-6709-46bc-b7b3-a1dfa2128b0c, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:24.543004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'port_id': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'mac_address': 'fa:16:3e:ca:c9:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1007, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:41:24.555973 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9724f2a5-3a3d-46e6-991b-ae4fa5101284 req-57bac3d8-caa1-42e7-bea7-52ebdc202725 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487754 Nov 11 11:41:24.600851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:24.619638 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4883439e-6709-46bc-b7b3-a1dfa2128b0c {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:41:24.634706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 4883439e-6709-46bc-b7b3-a1dfa2128b0c, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:24.663905 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:24.665942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:24.740737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=4883439e-6709-46bc-b7b3-a1dfa2128b0c,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:24.744015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:24.970540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ed1a5c-01ec-4c70-8369-e674c140ac49 req-c10fb844-0e27-432d-821e-2dca852c9058 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:24.972197 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68ed1a5c-01ec-4c70-8369-e674c140ac49 req-c10fb844-0e27-432d-821e-2dca852c9058 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.2634604 Nov 11 11:41:25.032254 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68ed1a5c-01ec-4c70-8369-e674c140ac49 req-f71d19ca-1c1e-4131-b64f-8c3db48a41d8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538440 Nov 11 11:41:25.253717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b81e5df-95f2-4355-9591-e2eeb73727c6 req-522dc879-6be0-457d-8200-a7303b3d2bea tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:25.255300 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b81e5df-95f2-4355-9591-e2eeb73727c6 req-522dc879-6be0-457d-8200-a7303b3d2bea tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 945 time: 0.1404562 Nov 11 11:41:25.316833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8609e669-798a-4fdb-ba6b-a8ce685440d9 req-01557191-d3ba-48f2-a5a9-6eedf2dc34ef tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:25.318385 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8609e669-798a-4fdb-ba6b-a8ce685440d9 req-01557191-d3ba-48f2-a5a9-6eedf2dc34ef tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1350062 Nov 11 11:41:25.346359 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b81e5df-95f2-4355-9591-e2eeb73727c6 req-e0448d0b-8a2c-40c8-86af-ccd9334b7751 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0840969 Nov 11 11:41:25.372932 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8609e669-798a-4fdb-ba6b-a8ce685440d9 req-df2f2925-ffe7-4b9a-9ab5-211c13430fe8 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473392 Nov 11 11:41:25.663099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['2149ca07-49c8-44c1-8765-765da866d5e8'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:41:25.965474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['4883439e-6709-46bc-b7b3-a1dfa2128b0c'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:41:26.254257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e228a2-34d3-417d-a2d0-7963d34edae6 req-e763ca3f-4f26-4870-b1ab-3f492ddba7f8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:26.255888 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3e228a2-34d3-417d-a2d0-7963d34edae6 req-e763ca3f-4f26-4870-b1ab-3f492ddba7f8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0854270 Nov 11 11:41:26.314773 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c3e228a2-34d3-417d-a2d0-7963d34edae6 req-cbfcd704-b72a-4395-9645-5b3fd7023e74 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513577 Nov 11 11:41:26.680779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44753bb-70e0-4e54-a218-19d7dd4da742 req-90907470-09da-4d91-b96d-6165c4ea7be0 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:26.682371 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a44753bb-70e0-4e54-a218-19d7dd4da742 req-90907470-09da-4d91-b96d-6165c4ea7be0 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1155372 Nov 11 11:41:26.689507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7977625e-ccd2-451d-bbcc-46d2455fc9c8 req-c3766773-2187-49b3-98aa-c56b44f0e942 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:26.691106 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7977625e-ccd2-451d-bbcc-46d2455fc9c8 req-c3766773-2187-49b3-98aa-c56b44f0e942 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 945 time: 0.2095017 Nov 11 11:41:26.774466 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a44753bb-70e0-4e54-a218-19d7dd4da742 req-f34e2bcf-cf7d-4a06-bab9-e206693ff1ba tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0823004 Nov 11 11:41:26.776762 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7977625e-ccd2-451d-bbcc-46d2455fc9c8 req-02505a0c-0ba5-4977-bd12-960f35b87d3b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0674176 Nov 11 11:41:27.551951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdee9cc-f954-45d6-8109-8778479b935b req-7a9bd6df-ac0b-4bb8-9e6a-829888d2c483 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:27.553696 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-efdee9cc-f954-45d6-8109-8778479b935b req-7a9bd6df-ac0b-4bb8-9e6a-829888d2c483 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0908015 Nov 11 11:41:27.604412 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-efdee9cc-f954-45d6-8109-8778479b935b req-5cedec41-609e-4012-9e56-03e5a37a7e17 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439751 Nov 11 11:41:27.784405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device e3d4fb61-8388-4546-8f10-81ccafd1477a details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:41:27.789497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 4883439e-6709-46bc-b7b3-a1dfa2128b0c up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:41:27.991961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port e3d4fb61-8388-4546-8f10-81ccafd1477a, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:28.006065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 4883439e-6709-46bc-b7b3-a1dfa2128b0c completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:41:28.010546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': 'e3d4fb61-8388-4546-8f10-81ccafd1477a', 'network_id': 'd616b076-b5a7-4954-b999-21a3b4c0cf2f', 'port_id': 'e3d4fb61-8388-4546-8f10-81ccafd1477a', 'mac_address': 'fa:16:3e:0d:f1:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1021, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c0ace514-c466-40d3-9d56-40ff46839783', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:41:28.013584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 4883439e-6709-46bc-b7b3-a1dfa2128b0c triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:41:28.014013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:28.070575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f65e15c-3786-49ae-a0c8-24306a0f149f req-994bc384-b3da-4680-afde-97619c8cb00d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:28.076291 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f65e15c-3786-49ae-a0c8-24306a0f149f req-994bc384-b3da-4680-afde-97619c8cb00d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 943 time: 0.1182251 Nov 11 11:41:28.078299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-566a3647-8b56-4024-858e-fb0d3a4bf0d7 req-ef6e12d0-db93-4d82-bd7d-2042afee0b27 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:28.079936 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-566a3647-8b56-4024-858e-fb0d3a4bf0d7 req-ef6e12d0-db93-4d82-bd7d-2042afee0b27 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 945 time: 0.1648171 Nov 11 11:41:28.125955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:28.157754 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e3d4fb61-8388-4546-8f10-81ccafd1477a {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:41:28.170214 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f65e15c-3786-49ae-a0c8-24306a0f149f req-6a9aade8-7fe6-4421-86fe-1cf545cabf45 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850079 Nov 11 11:41:28.177718 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-566a3647-8b56-4024-858e-fb0d3a4bf0d7 req-d6944cad-0104-4638-8bc1-ad92582f52c3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0745916 Nov 11 11:41:28.229654 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port e3d4fb61-8388-4546-8f10-81ccafd1477a, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:28.244726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:28.272713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4883439e-6709-46bc-b7b3-a1dfa2128b0c'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:28.281727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 4883439e-6709-46bc-b7b3-a1dfa2128b0c, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:28.289351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:28.291694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:28.338007 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'code': 200} Nov 11 11:41:28.338686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:28.339599 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 2149ca07-49c8-44c1-8765-765da866d5e8 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:41:28.418531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=e3d4fb61-8388-4546-8f10-81ccafd1477a,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:28.422130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:28.423877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.054s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:28.504066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=4883439e-6709-46bc-b7b3-a1dfa2128b0c,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:28.510154 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:28.592698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 2149ca07-49c8-44c1-8765-765da866d5e8 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:41:28.598952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 2149ca07-49c8-44c1-8765-765da866d5e8 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:41:28.599413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:28.739655 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba03650d-59cb-47f4-bc41-e82e6a3f06fb req-3dc5014d-ce9e-4f4f-b92f-ac1dfbf632e0 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 1099 time: 0.1006966 Nov 11 11:41:28.795616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:28.809787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['e3d4fb61-8388-4546-8f10-81ccafd1477a'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:41:28.881567 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba03650d-59cb-47f4-bc41-e82e6a3f06fb req-f07dee70-06fd-4f03-a833-978fcb50523a service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1334708 Nov 11 11:41:28.913781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ca74d05-6161-41b9-beda-52b24d75fa28 req-2fbbf47e-a20e-4cec-96d7-bb91d5474718 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:28.915956 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0ca74d05-6161-41b9-beda-52b24d75fa28 req-2fbbf47e-a20e-4cec-96d7-bb91d5474718 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1212993 Nov 11 11:41:28.945720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 2149ca07-49c8-44c1-8765-765da866d5e8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=2149ca07-49c8-44c1-8765-765da866d5e8,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:28.979184 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0ca74d05-6161-41b9-beda-52b24d75fa28 req-74c2c8d6-a514-46cb-acd3-d7ebdf1a7b43 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567231 Nov 11 11:41:28.989308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:28.994404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cda6b7b7-eb66-48ad-968b-4712e53e2e93 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:29.113886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=2149ca07-49c8-44c1-8765-765da866d5e8,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:29.119929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:29.254112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-344501bd-e966-4550-95ab-3882bb7f6701 req-5f3ca9fc-8232-40e8-b067-6adf3dad8f04 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:29.254441 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-344501bd-e966-4550-95ab-3882bb7f6701 req-5f3ca9fc-8232-40e8-b067-6adf3dad8f04 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1454468 Nov 11 11:41:29.270534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 59926) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:29.278039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'floatingip': {'port_id': '48b55264-0eab-46d7-abe8-ce455a036f49'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:41:29.429104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:29.472468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 59934) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:29.625650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f922165-bee7-4a3b-91db-da4af7341213 req-c184e7da-dabb-4999-b52b-bf334f94d3c9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:29.627427 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2f922165-bee7-4a3b-91db-da4af7341213 req-c184e7da-dabb-4999-b52b-bf334f94d3c9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 944 time: 0.2353644 Nov 11 11:41:29.641446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5465cd-a940-45c6-abdc-520564ccca95 req-845faa51-a6a6-4c9f-9c4a-af025363d85f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:29.643119 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0c5465cd-a940-45c6-abdc-520564ccca95 req-845faa51-a6a6-4c9f-9c4a-af025363d85f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1512065 Nov 11 11:41:29.720622 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0c5465cd-a940-45c6-abdc-520564ccca95 req-cb9aed1e-3a36-4807-8b45-daa28344522f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0598230 Nov 11 11:41:29.741081 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2f922165-bee7-4a3b-91db-da4af7341213 req-9fe01745-f7f4-48f0-bdab-c04181aaf9b4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065109 Nov 11 11:41:29.825000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:29.869703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:29.874312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Usage tracker for resource:security_group_rule and tenant:d687a86d00d94099a844ff41dc10c06f is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:29.881999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:29.884908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:29.971647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:30.015381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:30.025888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b9533185-61ba-494e-89e2-988a87d98630 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:30.078562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd83db0e-abb4-4b71-9ae9-71d25f49de37,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:30.087190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:30.091854 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d687a86d00d94099a844ff41dc10c06f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.6184835 Nov 11 11:41:30.096804 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 59952) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:30.186580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0e7c0149-c52e-4e8d-a364-4466b7d69c45 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:30.218197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0e7c0149-c52e-4e8d-a364-4466b7d69c45 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:30.298147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0e7c0149-c52e-4e8d-a364-4466b7d69c45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:30.304378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:30.335744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7c0149-c52e-4e8d-a364-4466b7d69c45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd83db0e-abb4-4b71-9ae9-71d25f49de37,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:30.339850 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0e7c0149-c52e-4e8d-a364-4466b7d69c45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:30.346991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66d508f1-193d-4909-a4cd-59458908d0df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2149ca07-49c8-44c1-8765-765da866d5e8'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:30.347162 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0e7c0149-c52e-4e8d-a364-4466b7d69c45 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:30.347162 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0e7c0149-c52e-4e8d-a364-4466b7d69c45 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/dd83db0e-abb4-4b71-9ae9-71d25f49de37 HTTP/1.1" status: 204 len: 168 time: 0.2447851 Nov 11 11:41:30.406045 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66d508f1-193d-4909-a4cd-59458908d0df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2149ca07-49c8-44c1-8765-765da866d5e8', 'code': 200} Nov 11 11:41:30.757334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:30.804724 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.079873 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a4fe8e35-02ed-48aa-b29a-c0743f08807f req-47a2133d-9de5-4796-9da5-5de30d656038 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1098 time: 0.2949097 Nov 11 11:41:31.092328 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Floating IP 0420fa6c-3891-40f6-9f28-c86b5986dbc2 associated. External IP: 172.27.3.92, port: 48b55264-0eab-46d7-abe8-ce455a036f49. Nov 11 11:41:31.115508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f9c315-18e5-462d-bae8-5b0d92d77a09 req-3d21954e-442a-439e-ba52-512e889275f4 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:31.117131 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5f9c315-18e5-462d-bae8-5b0d92d77a09 req-3d21954e-442a-439e-ba52-512e889275f4 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.2320914 Nov 11 11:41:31.126896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20120ac2-c7ea-4376-bf35-30a613e1f8c9 req-b5f99e60-2251-4254-bbce-672c83b17e4b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:31.128680 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-20120ac2-c7ea-4376-bf35-30a613e1f8c9 req-b5f99e60-2251-4254-bbce-672c83b17e4b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 944 time: 0.1835594 Nov 11 11:41:31.129349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 59988) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:31.199744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.248862 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a4fe8e35-02ed-48aa-b29a-c0743f08807f req-17511dcb-9ca0-4f10-8fb5-38a90d055874 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1609812 Nov 11 11:41:31.279536 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5f9c315-18e5-462d-bae8-5b0d92d77a09 req-e812fd4a-4016-4299-907d-c91e7adb2703 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1490390 Nov 11 11:41:31.284726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:31.288814 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-20120ac2-c7ea-4376-bf35-30a613e1f8c9 req-2d6b3229-e2bf-48da-964b-8161b55cead6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1510940 Nov 11 11:41:31.291407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Usage tracker for resource:security_group_rule and tenant:2ee9a91215da474eb24b1bcdc355ff2f is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:31.294513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:31.301308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:31.389911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.421832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.432642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a93f3c9d-a847-49eb-8ccd-54c82cf0171e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:31.545730 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2ee9a91215da474eb24b1bcdc355ff2f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4117427 Nov 11 11:41:31.551445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60002) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:31.557342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd982be0-d9fb-4663-aa6d-f84600673364,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:31.560652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:31.591891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e70386b-a938-4837-8cec-dfd27d1c3066 req-476dccc6-d47b-49be-8b3c-5e462beecfd2 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:31.593515 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3e70386b-a938-4837-8cec-dfd27d1c3066 req-476dccc6-d47b-49be-8b3c-5e462beecfd2 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1504941 Nov 11 11:41:31.603127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Router b0d78112-9416-496e-b447-57849419e81d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:41:31.604516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60008) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:31.611508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'floatingip': {'port_id': '4883439e-6709-46bc-b7b3-a1dfa2128b0c'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:41:31.711792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.723430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a72783f6-5253-45c5-be19-e641e18f8a76 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.763286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a72783f6-5253-45c5-be19-e641e18f8a76 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.798204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device e3d4fb61-8388-4546-8f10-81ccafd1477a up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:41:31.948816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:41:31.955977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port e3d4fb61-8388-4546-8f10-81ccafd1477a completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:41:31.957550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a72783f6-5253-45c5-be19-e641e18f8a76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.962332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port e3d4fb61-8388-4546-8f10-81ccafd1477a triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:41:31.962332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:31.963759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-038e91cf-4637-474b-be0a-a2897f54f5b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:31.967598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] Sync routers for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:41:31.986898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:41:31.987767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:41:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:32.008027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72783f6-5253-45c5-be19-e641e18f8a76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd982be0-d9fb-4663-aa6d-f84600673364,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:32.012062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a72783f6-5253-45c5-be19-e641e18f8a76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:32.025133 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:32.073800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a72783f6-5253-45c5-be19-e641e18f8a76 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:32.075095 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a72783f6-5253-45c5-be19-e641e18f8a76 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/bd982be0-d9fb-4663-aa6d-f84600673364 HTTP/1.1" status: 204 len: 168 time: 0.5225480 Nov 11 11:41:32.124511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:32.159274 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c5f6bcea-a27a-4330-b995-d0578d5bb311 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "PUT /v2.0/floatingips/0420fa6c-3891-40f6-9f28-c86b5986dbc2 HTTP/1.1" status: 200 len: 991 time: 2.8874302 Nov 11 11:41:32.160465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:32.221090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:41:32.241083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port e3d4fb61-8388-4546-8f10-81ccafd1477a, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:32.280665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:32.283964 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1408e288-9e35-40ba-bad4-6d9cd82d316a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:32.357888 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49', 'status': 'completed', 'code': 200} Nov 11 11:41:32.430386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ac7a6af-a9e4-4c03-894d-e9bad44fac64', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e3d4fb61-8388-4546-8f10-81ccafd1477a'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:32.448620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=e3d4fb61-8388-4546-8f10-81ccafd1477a,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:32.457919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:32.760863 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ac7a6af-a9e4-4c03-894d-e9bad44fac64', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e3d4fb61-8388-4546-8f10-81ccafd1477a', 'code': 200} Nov 11 11:41:32.768081 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '0420fa6c-3891-40f6-9f28-c86b5986dbc2', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'floating_ip_address': '172.27.3.92', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'b0d78112-9416-496e-b447-57849419e81d', 'port_id': '48b55264-0eab-46d7-abe8-ce455a036f49', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'mac_address': 'fa:16:3e:18:a5:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:40:39Z', 'updated_at': '2021-11-11T11:41:30Z', 'revision_number': 1, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:32.773841 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] Checking router: b0d78112-9416-496e-b447-57849419e81d for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:41:32.785523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:41:32.786207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:41:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:33.098530 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-97e89f9b-7b67-4cb6-aae6-e3fdfcfe5055 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1099 time: 0.6222305 Nov 11 11:41:33.147672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e054d340-9ca2-4f3e-ba6a-26b5ec8ad062 req-33f134bc-0c98-45bb-830b-35cf17089a33 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:33.149296 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e054d340-9ca2-4f3e-ba6a-26b5ec8ad062 req-33f134bc-0c98-45bb-830b-35cf17089a33 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.3132734 Nov 11 11:41:33.164098 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:41:33.337849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:33.386904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:33.464141 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e054d340-9ca2-4f3e-ba6a-26b5ec8ad062 req-a4ab7db8-fadd-407f-898c-2370a8e4cc9f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3002748 Nov 11 11:41:33.514121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-ca65ec23-3b36-443e-b234-3d4ec5b5d802 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:33.516216 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-ca65ec23-3b36-443e-b234-3d4ec5b5d802 service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.4032600 Nov 11 11:41:33.583205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60080) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:33.629851 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ab8151c9-baa8-4b37-9465-f86ce375e9c5 req-6ae50431-bd9d-4eca-b775-2fc0ffc987e1 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 1098 time: 0.4072521 Nov 11 11:41:33.784868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '0420fa6c-3891-40f6-9f28-c86b5986dbc2', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'floating_ip_address': '172.27.3.92', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'b0d78112-9416-496e-b447-57849419e81d', 'port_id': '48b55264-0eab-46d7-abe8-ce455a036f49', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'mac_address': 'fa:16:3e:18:a5:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:40:39Z', 'updated_at': '2021-11-11T11:41:30Z', 'revision_number': 1, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:33.803123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2adb6552-46ec-4693-832f-09f25f99f48f None None] The sync data for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi is: [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '0420fa6c-3891-40f6-9f28-c86b5986dbc2', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'floating_ip_address': '172.27.3.92', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'b0d78112-9416-496e-b447-57849419e81d', 'port_id': '48b55264-0eab-46d7-abe8-ce455a036f49', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'mac_address': 'fa:16:3e:18:a5:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:40:39Z', 'updated_at': '2021-11-11T11:41:30Z', 'revision_number': 1, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:41:33.804765 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-962b50f5-7d22-47a9-917e-f035b6bf7fd6 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=48b55264-0eab-46d7-abe8-ce455a036f49 HTTP/1.1" status: 200 len: 999 time: 0.2636659 Nov 11 11:41:33.820835 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ab8151c9-baa8-4b37-9465-f86ce375e9c5 req-ca6444c1-3431-40c2-a4d7-fd7475925a93 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1807599 Nov 11 11:41:33.870908 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Floating IP dcc10784-fe23-4ae4-b39b-f0f518d37c12 associated. External IP: 172.27.3.26, port: 4883439e-6709-46bc-b7b3-a1dfa2128b0c. Nov 11 11:41:33.946529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:33.989992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:33.994770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Usage tracker for resource:security_group_rule and tenant:bea5f772beb0474facf43fdccfb47ce2 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:33.998760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:34.006007 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:34.089674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:34.132090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:34.141978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dc17038d-2026-40c0-a707-4612c2c8d04f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:34.281403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4194d219-c3fb-4304-9231-d0c086f8fadb,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:34.289015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:34.305277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60098) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:34.311721 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bea5f772beb0474facf43fdccfb47ce2&name=default HTTP/1.1" status: 200 len: 2647 time: 0.7270286 Nov 11 11:41:34.337779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-ba23be30-4a39-4a43-b304-b747c73fc551 service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:34.339362 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-ba23be30-4a39-4a43-b304-b747c73fc551 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.1440754 Nov 11 11:41:34.348571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf147e5f-4c61-4f11-9787-b3dae36496bb None None] New status for floating IP 0420fa6c-3891-40f6-9f28-c86b5986dbc2: ACTIVE {{(pid=88330) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:41:34.589224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5cf7b800-e973-4d25-9c6f-b06ff933390f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:34.614535 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-22686b95-beeb-4b0f-ae10-4f4d610f02de service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2566855 Nov 11 11:41:34.654243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5cf7b800-e973-4d25-9c6f-b06ff933390f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:34.701282 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:35.032352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Router bf5e2202-8700-46f0-9f7b-d7820ecb5663 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:41:35.074104 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-503e123f-0b5a-43b2-88c5-99f78f96cd95 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4456851 Nov 11 11:41:35.181271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5cf7b800-e973-4d25-9c6f-b06ff933390f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:35.209131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:35.222374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20733f9-e878-45bc-a0fb-4bc8068d7935 req-0c68ba07-87f8-4568-a10a-f2f731e280fc tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:35.224027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c20733f9-e878-45bc-a0fb-4bc8068d7935 req-0c68ba07-87f8-4568-a10a-f2f731e280fc tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.3374784 Nov 11 11:41:35.290513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf7b800-e973-4d25-9c6f-b06ff933390f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4194d219-c3fb-4304-9231-d0c086f8fadb,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:35.319918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5cf7b800-e973-4d25-9c6f-b06ff933390f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:35.352209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5cf7b800-e973-4d25-9c6f-b06ff933390f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:35.355965 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5cf7b800-e973-4d25-9c6f-b06ff933390f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4194d219-c3fb-4304-9231-d0c086f8fadb HTTP/1.1" status: 204 len: 168 time: 1.0470181 Nov 11 11:41:35.402359 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5ba150-93d3-4122-a33f-ec9a3e0973e6 req-493d65b0-7c67-46a6-8fd4-67d73dd339ad service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3169954 Nov 11 11:41:35.405024 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c20733f9-e878-45bc-a0fb-4bc8068d7935 req-70504496-f915-4483-909b-840e2f9185aa tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1236811 Nov 11 11:41:35.547400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:41:35.559830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] Sync routers for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:41:35.560421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:35.590950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:41:35.591696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:41:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:35.657706 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-64e77cb0-ba38-4dc4-bc8e-ee1ff3433ce9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "PUT /v2.0/floatingips/dcc10784-fe23-4ae4-b39b-f0f518d37c12 HTTP/1.1" status: 200 len: 991 time: 4.0519235 Nov 11 11:41:35.658617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'tag': '4883439e-6709-46bc-b7b3-a1dfa2128b0c'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:35.794173 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'tag': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'status': 'completed', 'code': 200} Nov 11 11:41:36.005498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:41:36.009869 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8b21853-c170-40e9-86b9-45126a88e524 req-850a2d72-e940-4c1b-acf0-21c6b6601cac service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 1099 time: 0.1342428 Nov 11 11:41:36.188900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b21853-c170-40e9-86b9-45126a88e524 req-a12b4914-10f0-41c1-b158-1cfc392c0b62 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:36.190852 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8b21853-c170-40e9-86b9-45126a88e524 req-a12b4914-10f0-41c1-b158-1cfc392c0b62 service neutron] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 913 time: 0.1639051 Nov 11 11:41:36.341943 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8b21853-c170-40e9-86b9-45126a88e524 req-c0b67dcf-ad55-4480-b9f3-fd9dc9e05a24 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c HTTP/1.1" status: 200 len: 999 time: 0.1441729 Nov 11 11:41:36.347804 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60160) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:36.437397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:36.485376 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b21853-c170-40e9-86b9-45126a88e524 req-29a5cb9d-2cd6-4a78-b558-4b474d45d8a4 service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:36.485376 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8b21853-c170-40e9-86b9-45126a88e524 req-29a5cb9d-2cd6-4a78-b558-4b474d45d8a4 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.1334467 Nov 11 11:41:36.603011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:36.609526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Usage tracker for resource:security_group_rule and tenant:d0b2b1d6605b4965b1b376d9582fcbad is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:36.652374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:36.671454 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:36.743167 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dcc10784-fe23-4ae4-b39b-f0f518d37c12', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'floating_ip_address': '172.27.3.26', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'port_id': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'mac_address': 'fa:16:3e:ca:c9:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:40:31Z', 'updated_at': '2021-11-11T11:41:32Z', 'revision_number': 1, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:36.745351 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8b21853-c170-40e9-86b9-45126a88e524 req-8813839e-028d-4eca-8329-361908cf8620 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2530699 Nov 11 11:41:36.748278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] Checking router: bf5e2202-8700-46f0-9f7b-d7820ecb5663 for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:41:36.760953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:41:36.761638 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:41:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:36.790727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c66145e-4739-4159-baba-2b82b0b58e25 req-b16aa3d9-2bec-4e4e-ab02-71a758cc9497 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:36.792407 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6c66145e-4739-4159-baba-2b82b0b58e25 req-b16aa3d9-2bec-4e4e-ab02-71a758cc9497 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1864340 Nov 11 11:41:36.949655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:36.962997 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:41:36.968095 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6c66145e-4739-4159-baba-2b82b0b58e25 req-ce3ca74e-c13f-46f9-9f0b-823c885cbf72 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1632590 Nov 11 11:41:36.990289 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8b21853-c170-40e9-86b9-45126a88e524 req-56644d77-8137-4879-89d3-1ce95e99d3c2 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2302840 Nov 11 11:41:36.992136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:37.002240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dbf21f2c-d281-48d8-bb43-b45c113fc9ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:37.150159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=065171c0-2d7d-4e7e-83a6-4918737a4a63,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:37.180806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:37.185783 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d0b2b1d6605b4965b1b376d9582fcbad&name=default HTTP/1.1" status: 200 len: 2647 time: 0.8363197 Nov 11 11:41:37.189410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60182) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:37.192341 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8b21853-c170-40e9-86b9-45126a88e524 req-bb19fb70-259f-49d2-9a6b-aa8030fff328 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1917679 Nov 11 11:41:37.274002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8d1d75b5-61b4-4e2f-8578-d60fc105f6c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:37.308908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8d1d75b5-61b4-4e2f-8578-d60fc105f6c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:37.380463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dcc10784-fe23-4ae4-b39b-f0f518d37c12', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'floating_ip_address': '172.27.3.26', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'port_id': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'mac_address': 'fa:16:3e:ca:c9:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:40:31Z', 'updated_at': '2021-11-11T11:41:32Z', 'revision_number': 1, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:37.384882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87b91b7b-b403-4e0f-b5ac-181dc3141b82 None None] The sync data for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi is: [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dcc10784-fe23-4ae4-b39b-f0f518d37c12', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'floating_ip_address': '172.27.3.26', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'port_id': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'mac_address': 'fa:16:3e:ca:c9:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:40:31Z', 'updated_at': '2021-11-11T11:41:32Z', 'revision_number': 1, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:41:37.629278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8d1d75b5-61b4-4e2f-8578-d60fc105f6c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:37.634624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:37.648119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1d75b5-61b4-4e2f-8578-d60fc105f6c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=065171c0-2d7d-4e7e-83a6-4918737a4a63,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:37.653683 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8d1d75b5-61b4-4e2f-8578-d60fc105f6c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:37.660126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8d1d75b5-61b4-4e2f-8578-d60fc105f6c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:37.661557 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8d1d75b5-61b4-4e2f-8578-d60fc105f6c3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/065171c0-2d7d-4e7e-83a6-4918737a4a63 HTTP/1.1" status: 204 len: 168 time: 0.4708672 Nov 11 11:41:37.826040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dec2300-812b-4e64-9ff7-0227c26e10e7 req-135b3337-13f8-425f-b054-ba23b48eaf1a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:37.827774 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5dec2300-812b-4e64-9ff7-0227c26e10e7 req-135b3337-13f8-425f-b054-ba23b48eaf1a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.2248030 Nov 11 11:41:37.902097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa047b6c-2e9b-453c-87bd-b0ef7841cb54 None None] New status for floating IP dcc10784-fe23-4ae4-b39b-f0f518d37c12: ACTIVE {{(pid=88330) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:41:37.907113 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-babb817d-d976-4893-aeff-daace7c0cbb1 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 1098 time: 0.2655592 Nov 11 11:41:37.990470 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5dec2300-812b-4e64-9ff7-0227c26e10e7 req-033e184c-7ccc-4696-9047-4477c0ec2406 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440852 Nov 11 11:41:38.123323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-834e4bbe-784c-4029-a2be-7445b7aebb0e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:38.125175 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-834e4bbe-784c-4029-a2be-7445b7aebb0e service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.2037446 Nov 11 11:41:38.318017 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-aafac058-11b8-45b4-909e-79a5692f117e service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a HTTP/1.1" status: 200 len: 217 time: 0.1714742 Nov 11 11:41:38.398375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-cee10095-8981-4ea8-a09e-a06ae226f9fb service neutron] Attributes excluded by policy engine: ['shared'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:38.399981 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-cee10095-8981-4ea8-a09e-a06ae226f9fb service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.0810986 Nov 11 11:41:38.468582 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-2eb3ca8d-85c3-4901-9987-0ccc3e356a1e service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0481086 Nov 11 11:41:38.668824 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-3dc1f5ec-dd64-4e3a-92ac-1f2bb4c0b321 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1858582 Nov 11 11:41:39.218146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e1bbbc1-2d4e-4516-aca8-449833ec6477 req-35274c71-bd38-4e08-8da6-99e78a7e44cb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:39.220391 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0e1bbbc1-2d4e-4516-aca8-449833ec6477 req-35274c71-bd38-4e08-8da6-99e78a7e44cb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0878994 Nov 11 11:41:39.273823 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0e1bbbc1-2d4e-4516-aca8-449833ec6477 req-9cc9e796-e8a2-4aca-928f-5448e7f055e2 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456369 Nov 11 11:41:39.698759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60266) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:39.857618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:39.891586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:39.895690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Usage tracker for resource:security_group_rule and tenant:021ce3acd3744c77a97b7dadab1747f4 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:39.898811 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:39.904883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:40.038273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3da1862a-ce2b-4b19-91e5-de8165bb0d50 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:40.038576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:40.072881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:40.084089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:40.135549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1c4286d-49d4-411b-b8f9-d4d5477295f4,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:40.140014 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=021ce3acd3744c77a97b7dadab1747f4&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4401007 Nov 11 11:41:40.142116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:40.143382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60282) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:40.540786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c14b258-91e3-4b74-a664-adab19560f91 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:40.558602 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d7c229d-eb6d-4028-bd21-f29564fbcb50 req-fa29c3a9-e8ab-44df-9617-2b04b257b9f8 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4119761 Nov 11 11:41:40.575714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c14b258-91e3-4b74-a664-adab19560f91 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:40.749232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c14b258-91e3-4b74-a664-adab19560f91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:40.754928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9dc4f327-97ac-4b93-9a90-19290118dd1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:40.771284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c14b258-91e3-4b74-a664-adab19560f91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1c4286d-49d4-411b-b8f9-d4d5477295f4,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:40.774369 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6c14b258-91e3-4b74-a664-adab19560f91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:40.790303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c14b258-91e3-4b74-a664-adab19560f91 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:40.790303 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6c14b258-91e3-4b74-a664-adab19560f91 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f1c4286d-49d4-411b-b8f9-d4d5477295f4 HTTP/1.1" status: 204 len: 168 time: 0.6399169 Nov 11 11:41:41.292461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:41.398869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba290d31-5178-43d8-b7a7-9317d9945d88 req-ae39f9e4-8ec0-4858-9899-bd23169ccb3a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:41.400618 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba290d31-5178-43d8-b7a7-9317d9945d88 req-ae39f9e4-8ec0-4858-9899-bd23169ccb3a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0897467 Nov 11 11:41:41.458080 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba290d31-5178-43d8-b7a7-9317d9945d88 req-1c7d41e5-ec07-4371-a79e-f7b4b74fef29 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504575 Nov 11 11:41:41.549303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60324) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:41.570050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:41.604204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:41.608620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Usage tracker for resource:security_group_rule and tenant:9fadfa066ac04aafb7bd329b3cb03d49 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:41.612995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:41.621023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:41.694949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:41.734774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:41.742908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-75427736-fce0-4cb9-b9d6-3e30bd2edce8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:41.787703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe7962e7-02ce-42ad-9f31-c7f523eb5c6b,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:41.794932 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9fadfa066ac04aafb7bd329b3cb03d49&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2417762 Nov 11 11:41:41.794932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:41.795306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60332) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:41.871018 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-671791e8-2f4c-49fb-aaa2-0f2919a4e8dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:41.901392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-671791e8-2f4c-49fb-aaa2-0f2919a4e8dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:41.998127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-671791e8-2f4c-49fb-aaa2-0f2919a4e8dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:42.002952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dd8deb1a-a104-48ea-bf7f-1f48872c1a95 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:42.015668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-671791e8-2f4c-49fb-aaa2-0f2919a4e8dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe7962e7-02ce-42ad-9f31-c7f523eb5c6b,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:42.019779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-671791e8-2f4c-49fb-aaa2-0f2919a4e8dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:42.023247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-671791e8-2f4c-49fb-aaa2-0f2919a4e8dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:42.024759 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-671791e8-2f4c-49fb-aaa2-0f2919a4e8dd admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/fe7962e7-02ce-42ad-9f31-c7f523eb5c6b HTTP/1.1" status: 204 len: 168 time: 0.2282152 Nov 11 11:41:43.206893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac7cf0c7-f69e-4d86-b31b-7983956bec65 req-b4123bb5-3070-43c8-b979-afc623e916de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:43.207452 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ac7cf0c7-f69e-4d86-b31b-7983956bec65 req-b4123bb5-3070-43c8-b979-afc623e916de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0887842 Nov 11 11:41:43.262147 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ac7cf0c7-f69e-4d86-b31b-7983956bec65 req-6b2e2692-ed7d-49d1-8e1d-4786d3903cb9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481446 Nov 11 11:41:43.487064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:43.487898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5fce6451-e10a-4408-bc00-b8eb7673836b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:44.402225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b21f5e3-171d-4e12-9778-5576fdb16532 req-af8aef13-826d-4850-9e1c-3c08163b9691 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:44.403808 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b21f5e3-171d-4e12-9778-5576fdb16532 req-af8aef13-826d-4850-9e1c-3c08163b9691 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.1094208 Nov 11 11:41:44.524225 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b21f5e3-171d-4e12-9778-5576fdb16532 req-2377f35a-11c6-4c3c-8329-2b0f509b0ac7 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830090 Nov 11 11:41:44.533850 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82025097-9304-46e3-ab3a-16146688dc03 req-5d2b36ca-c094-427a-9730-2b4bca868886 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:44.535487 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-82025097-9304-46e3-ab3a-16146688dc03 req-5d2b36ca-c094-427a-9730-2b4bca868886 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1306694 Nov 11 11:41:44.628120 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-82025097-9304-46e3-ab3a-16146688dc03 req-b795fee4-55a2-4d83-a3f4-e3166d13929e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854921 Nov 11 11:41:44.634860 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:45.779189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e057ae-9252-4a79-abb3-e06732cd7e6d req-663c4111-d6a8-49e2-8a12-456ff6783e8c tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:45.781053 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-85e057ae-9252-4a79-abb3-e06732cd7e6d req-663c4111-d6a8-49e2-8a12-456ff6783e8c tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.0987599 Nov 11 11:41:45.887477 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-85e057ae-9252-4a79-abb3-e06732cd7e6d req-24ce3512-0bcb-4c4c-bb68-47b0fb60e83c tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686111 Nov 11 11:41:45.912715 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda80c52-d440-4304-9c12-cd50b3f64880 req-9cf4524a-f18f-438e-919c-676675a4e323 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:45.914287 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cda80c52-d440-4304-9c12-cd50b3f64880 req-9cf4524a-f18f-438e-919c-676675a4e323 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1316211 Nov 11 11:41:45.971563 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cda80c52-d440-4304-9c12-cd50b3f64880 req-811f82ea-db78-41da-8f24-56b1eaa18160 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486887 Nov 11 11:41:46.887751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-86d102d8-ab28-4694-99ec-a645a083efbd tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:46.889227 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-86d102d8-ab28-4694-99ec-a645a083efbd tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.60 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.0814183 Nov 11 11:41:46.974150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Deleting port d406b7f5-8b66-41f4-b933-ed75fdf4d06e {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:41:46.974539 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:47.330718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b6ce28-e238-45c2-b2df-fe7ba0f3070d req-4cb51d35-ebce-4072-8186-bc45994b05a8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:47.332357 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f9b6ce28-e238-45c2-b2df-fe7ba0f3070d req-4cb51d35-ebce-4072-8186-bc45994b05a8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 945 time: 0.3034050 Nov 11 11:41:47.413986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] For port d406b7f5-8b66-41f4-b933-ed75fdf4d06e, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,segment=NetworkSegment(f738a606-21d7-4c80-9a99-5e69bf9a03d2),segment_id=f738a606-21d7-4c80-9a99-5e69bf9a03d2)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:41:47.414308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:47.433895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63cba59d-6412-4d27-8972-7073eaa98464 req-4027801b-41b0-447e-a581-97403583ffce tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:47.435618 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-63cba59d-6412-4d27-8972-7073eaa98464 req-4027801b-41b0-447e-a581-97403583ffce tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.2727334 Nov 11 11:41:47.568366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Calling delete_port for d406b7f5-8b66-41f4-b933-ed75fdf4d06e owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:41:47.601056 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f9b6ce28-e238-45c2-b2df-fe7ba0f3070d req-4ce0bd99-d5eb-459a-8edc-af900fd6adda tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/security-groups?id=f4ebddd5-d236-47a2-affc-c5ded3fd45d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2541938 Nov 11 11:41:47.754038 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-63cba59d-6412-4d27-8972-7073eaa98464 req-f6346e3d-beb5-43cd-bfdf-a180f917dcf9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1942554 Nov 11 11:41:47.952135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:47.959857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:48.003040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Pushing event deleted for resources: {'Port': ['ID=d406b7f5-8b66-41f4-b933-ed75fdf4d06e,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:48.007930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:48.086802 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] No DVR routers for this DVR port d406b7f5-8b66-41f4-b933-ed75fdf4d06e on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:41:48.089820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:48.095098 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43d2e685-b837-4758-b0be-7f4308a961e4', 'name': 'network-vif-deleted', 'tag': 'd406b7f5-8b66-41f4-b933-ed75fdf4d06e'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:41:48.143833 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f77731c6-601c-44f5-b0d9-e6031eed89dc req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.60 "DELETE /v2.0/ports/d406b7f5-8b66-41f4-b933-ed75fdf4d06e HTTP/1.1" status: 204 len: 173 time: 1.2404623 Nov 11 11:41:48.157109 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43d2e685-b837-4758-b0be-7f4308a961e4', 'name': 'network-vif-deleted', 'tag': 'd406b7f5-8b66-41f4-b933-ed75fdf4d06e', 'status': 'completed', 'code': 200} Nov 11 11:41:48.846398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-69561b38-6768-4bbb-9398-8fb63cb1b932 req-919efdd0-aa23-467f-9116-430b2f44c836 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Synchronizing usage tracker for tenant:494d10266beb49e2a9a6952aeefc82ef on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:41:48.976479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-69561b38-6768-4bbb-9398-8fb63cb1b932 req-919efdd0-aa23-467f-9116-430b2f44c836 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Unset dirty status for tenant:494d10266beb49e2a9a6952aeefc82ef on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:41:48.977791 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-69561b38-6768-4bbb-9398-8fb63cb1b932 req-919efdd0-aa23-467f-9116-430b2f44c836 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] 10.222.0.11 "GET /v2.0/ports?device_id=43d2e685-b837-4758-b0be-7f4308a961e4 HTTP/1.1" status: 200 len: 210 time: 0.2211146 Nov 11 11:41:49.028621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f6fa86-8fd7-466f-bf7d-b666e1ba0a92 req-edf4e681-021c-4c85-8b8e-d2e0d4ed83cb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:49.030321 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a4f6fa86-8fd7-466f-bf7d-b666e1ba0a92 req-edf4e681-021c-4c85-8b8e-d2e0d4ed83cb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0945907 Nov 11 11:41:49.100587 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a4f6fa86-8fd7-466f-bf7d-b666e1ba0a92 req-9a800e9a-4caa-4212-ad5c-d9f89cfb4fc1 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0608888 Nov 11 11:41:49.339950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60604) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:49.561212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:49.594689 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:49.598829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Usage tracker for resource:security_group_rule and tenant:3df41b3f7dcd4730a4e0edab3b773134 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:49.601737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:49.609793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:49.706290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:49.769222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:49.778913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-06f55316-db2a-4a88-b201-92b240fe65f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:49.827503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2575f9ac-cc12-4552-a5f1-10afa9f25123,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:49.831702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:49.834736 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3df41b3f7dcd4730a4e0edab3b773134&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4936838 Nov 11 11:41:49.838058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60616) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:49.862223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device d406b7f5-8b66-41f4-b933-ed75fdf4d06e no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:41:49.893982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60620) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:49.905536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: d406b7f5-8b66-41f4-b933-ed75fdf4d06e {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:41:49.905536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device d406b7f5-8b66-41f4-b933-ed75fdf4d06e not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:41:49.914354 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e2bb9dd5-fbef-4b17-ae7b-6de54a488069 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:49.944772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e2bb9dd5-fbef-4b17-ae7b-6de54a488069 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.026369 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e2bb9dd5-fbef-4b17-ae7b-6de54a488069 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.034420 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:50.049508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e2bb9dd5-fbef-4b17-ae7b-6de54a488069 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.053580 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e2bb9dd5-fbef-4b17-ae7b-6de54a488069 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2575f9ac-cc12-4552-a5f1-10afa9f25123 HTTP/1.1" status: 204 len: 168 time: 0.2142689 Nov 11 11:41:50.054663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2bb9dd5-fbef-4b17-ae7b-6de54a488069 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2575f9ac-cc12-4552-a5f1-10afa9f25123,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:50.064493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e2bb9dd5-fbef-4b17-ae7b-6de54a488069 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:50.082667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.132769 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:50.137368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Usage tracker for resource:security_group_rule and tenant:edb5efbd772741acbdf62130e4d8d060 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:50.141861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:50.151843 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:50.352377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.362307 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8900bc88-5032-4dcd-99f4-0a53975a4e6b req-b00b4eba-b883-4333-8bb0-c4e13757cb5d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:50.362307 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8900bc88-5032-4dcd-99f4-0a53975a4e6b req-b00b4eba-b883-4333-8bb0-c4e13757cb5d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1391151 Nov 11 11:41:50.389350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.402967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:50.459020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f80335cd-57e4-4c05-b0a9-48e0d4d20ba1,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:50.467114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:50.471317 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8900bc88-5032-4dcd-99f4-0a53975a4e6b req-dc0118b8-9593-47ef-9d7c-0ef89c6e49a4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1032681 Nov 11 11:41:50.474603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=edb5efbd772741acbdf62130e4d8d060&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5786819 Nov 11 11:41:50.478887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60650) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:50.573911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf261aca-5616-41be-9151-e55121f2884a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.603434 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf261aca-5616-41be-9151-e55121f2884a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.732159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf261aca-5616-41be-9151-e55121f2884a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.740680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:50.749528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf261aca-5616-41be-9151-e55121f2884a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f80335cd-57e4-4c05-b0a9-48e0d4d20ba1,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:50.753849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bf261aca-5616-41be-9151-e55121f2884a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:50.757272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf261aca-5616-41be-9151-e55121f2884a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.761458 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-bf261aca-5616-41be-9151-e55121f2884a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f80335cd-57e4-4c05-b0a9-48e0d4d20ba1 HTTP/1.1" status: 204 len: 168 time: 0.2813463 Nov 11 11:41:50.857955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60662) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:50.878457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:50.912380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:50.916523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Usage tracker for resource:security_group_rule and tenant:dab921cc48a4417e9daae9ce58c072bd is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:50.919469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:50.925803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:51.005457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.077407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.086090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:51.133492 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=170592df-81a7-4d42-aa90-66e78c6a8fa2,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:51.136867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:51.142974 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=dab921cc48a4417e9daae9ce58c072bd&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2805777 Nov 11 11:41:51.145106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60672) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:51.214477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-499d3110-f07e-4e23-9f45-9177d41459d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.243139 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-499d3110-f07e-4e23-9f45-9177d41459d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.330086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-499d3110-f07e-4e23-9f45-9177d41459d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.335988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:51.350855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-499d3110-f07e-4e23-9f45-9177d41459d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=170592df-81a7-4d42-aa90-66e78c6a8fa2,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:51.354034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-499d3110-f07e-4e23-9f45-9177d41459d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:51.354978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-499d3110-f07e-4e23-9f45-9177d41459d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.356241 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-499d3110-f07e-4e23-9f45-9177d41459d4 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/170592df-81a7-4d42-aa90-66e78c6a8fa2 HTTP/1.1" status: 204 len: 168 time: 0.2099240 Nov 11 11:41:51.387604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60688) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:51.411644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.458144 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:51.464175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Usage tracker for resource:security_group_rule and tenant:6368bcfda8854711bc13fc4a2fb2c3e5 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:51.464606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60694) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:51.467452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:51.486028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:51.491901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60700) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:51.653791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.658753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Deleting subnet 686de8d6-9d14-4c91-b935-fadb3938297c {{(pid=88329) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:41:51.666339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.723906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.763311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e2bb9dd5-fbef-4b17-ae7b-6de54a488069 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:51.773293 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6368bcfda8854711bc13fc4a2fb2c3e5&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3840618 Nov 11 11:41:51.777632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60708) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:51.793072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.797458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.821511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.828867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b94eb65d-a888-40f2-bd10-3d2942cc1259,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:51.834377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:51.881527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0d3edce9-e57f-4183-b43e-8f0fea810061 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.919555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0d3edce9-e57f-4183-b43e-8f0fea810061 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:51.938303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:51.948476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2adccd6b-94ce-4c49-b3f3-2a91fb2f2678 req-fc17bde0-ae13-4ffd-8ba8-78207504e85b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:51.950223 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2adccd6b-94ce-4c49-b3f3-2a91fb2f2678 req-fc17bde0-ae13-4ffd-8ba8-78207504e85b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.2482715 Nov 11 11:41:51.951332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Usage tracker for resource:security_group_rule and tenant:f0ad4e893c994db3be5a7e0dcb86e7f0 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:51.954639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:51.976909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:52.010672 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2adccd6b-94ce-4c49-b3f3-2a91fb2f2678 req-097e1086-9b25-4a89-b9e9-ca5fd88d50e8 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527401 Nov 11 11:41:52.112401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0d3edce9-e57f-4183-b43e-8f0fea810061 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.118302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9d3a70bf-539b-41cc-90c6-aa2df74c98e8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:52.132735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3edce9-e57f-4183-b43e-8f0fea810061 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b94eb65d-a888-40f2-bd10-3d2942cc1259,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:52.135343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0d3edce9-e57f-4183-b43e-8f0fea810061 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:52.138837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0d3edce9-e57f-4183-b43e-8f0fea810061 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.140883 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0d3edce9-e57f-4183-b43e-8f0fea810061 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b94eb65d-a888-40f2-bd10-3d2942cc1259 HTTP/1.1" status: 204 len: 168 time: 0.3613894 Nov 11 11:41:52.222121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.224351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for subnet, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.230009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:52.269323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=686de8d6-9d14-4c91-b935-fadb3938297c,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:52.271970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:52.275506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.284340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-11942031-d3f1-4b17-98be-f6a97a12c8b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:52.312424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60728) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:52.338729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.367751 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f0ad4e893c994db3be5a7e0dcb86e7f0&name=default HTTP/1.1" status: 200 len: 2647 time: 0.8993704 Nov 11 11:41:52.368500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60734) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:52.371912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f4d1c2e-1d76-4c49-9f16-3e6450fb33e3,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:52.377457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:52.388235 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/686de8d6-9d14-4c91-b935-fadb3938297c HTTP/1.1" status: 204 len: 168 time: 0.8947282 Nov 11 11:41:52.391653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60738) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:52.404506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Deleting subnet 6475e617-8ff3-42cb-968f-868863503d26 {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:41:52.415341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.509936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036850920695'] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.613242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7bb88f82-f323-471c-82d8-8a5626b3995d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.661264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7bb88f82-f323-471c-82d8-8a5626b3995d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.673432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.732927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.832888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2678040', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2638849'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.840895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6f836c1e-752c-4d10-ba0c-3d1669bb060b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:52.875450 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60750) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:52.901353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6475e617-8ff3-42cb-968f-868863503d26,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:52.905686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7bb88f82-f323-471c-82d8-8a5626b3995d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.908029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.921070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.926266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:52.928392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1165c935-4517-4423-a192-e0a3d0af43d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:52.949190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.949738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.950261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:52.950569 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.950944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > port after_create 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.951725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > port after_delete 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.952098 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > port after_update 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.952468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.953398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.953767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.954132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:52.971509 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb88f82-f323-471c-82d8-8a5626b3995d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f4d1c2e-1d76-4c49-9f16-3e6450fb33e3,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:52.986941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7bb88f82-f323-471c-82d8-8a5626b3995d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:53.001593 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/6475e617-8ff3-42cb-968f-868863503d26 HTTP/1.1" status: 204 len: 168 time: 0.6836450 Nov 11 11:41:53.008019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60758) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:53.014789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7bb88f82-f323-471c-82d8-8a5626b3995d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.016989 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-7bb88f82-f323-471c-82d8-8a5626b3995d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8f4d1c2e-1d76-4c49-9f16-3e6450fb33e3 HTTP/1.1" status: 204 len: 168 time: 0.6475117 Nov 11 11:41:53.037221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:53.037607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:53.039447 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:53.039833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=88329) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Nov 11 11:41:53.040224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d96f60da-8359-4d6c-b86e-3c6808992146']}} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:53.064102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2a6aa7cf-bcea-4f0c-a38a-f91f464ae8b6') {'for_net_delete': True} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:53.064102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2a6aa7cf-bcea-4f0c-a38a-f91f464ae8b6') {} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:53.081535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2720042'] for segment, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.096040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:53.125286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.136742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Releasing vlan 1010 on physical network physnet1 to pool {{(pid=88329) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:41:53.137183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2720660'] for segment, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1917: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding will be deprecated in SQLAlchemy 1.4, and will be disallowed in a future release. viewonly relationships should not be mutated (this warning may be suppressed after 10 occurrences) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: (self, other), Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1917: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags will be deprecated in SQLAlchemy 1.4, and will be disallowed in a future release. viewonly relationships should not be mutated (this warning may be suppressed after 10 occurrences) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: (self, other), Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:41:53.166589 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:41:53.179900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.183817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Usage tracker for resource:security_group_rule and tenant:80336956d32448a382d18d9ef8758930 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:53.186854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:53.195289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:53.355034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cced1109-82c7-4fb9-8d61-fb6e05fd61c6 req-3b551bf2-03b3-412e-9423-399d3147524c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:53.356914 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cced1109-82c7-4fb9-8d61-fb6e05fd61c6 req-3b551bf2-03b3-412e-9423-399d3147524c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1028683 Nov 11 11:41:53.358255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.363451 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.364185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:53.399075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.410805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Pushing event deleted for resources: {'Network': ['ID=d96f60da-8359-4d6c-b86e-3c6808992146,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:53.412130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7c4246da-4773-4e75-9daa-b9c878c13272']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:53.416521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:53.477168 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] 10.222.0.11 "DELETE /v2.0/networks/d96f60da-8359-4d6c-b86e-3c6808992146 HTTP/1.1" status: 204 len: 168 time: 1.0269883 Nov 11 11:41:53.477168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60770) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:53.503819 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cced1109-82c7-4fb9-8d61-fb6e05fd61c6 req-123a9a42-336b-4c13-8128-73735768e2c6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1227994 Nov 11 11:41:53.540125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Deleting subnet 8efc991d-1af9-46d3-b626-ba7a22473ffc {{(pid=88329) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:41:53.637407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f738a606-21d7-4c80-9a99-5e69bf9a03d2') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:53.637741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f738a606-21d7-4c80-9a99-5e69bf9a03d2') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:53.646404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.652572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.751913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.759190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d06893f8-46ea-4947-b091-0d7b8cd24cf7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:53.802386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7052c3b4-6884-48a3-8572-12e5ce4f034f,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:53.806826 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=80336956d32448a382d18d9ef8758930&name=default HTTP/1.1" status: 200 len: 2647 time: 0.9319804 Nov 11 11:41:53.807904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:53.809486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.811233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60776) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:53.865724 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852055773'] for subnet, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.876535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aaba4246-6bf1-4ae6-8cda-09a42bcef29e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.903134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aaba4246-6bf1-4ae6-8cda-09a42bcef29e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.910711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.925260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.932308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Releasing vlan 1016 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:41:53.932308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:41:53.942239 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:41:54.084045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852055754', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036852017038'] for subnet, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.084888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.088015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aaba4246-6bf1-4ae6-8cda-09a42bcef29e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.092446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:54.093312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-eeb40a08-1907-4a63-87f2-887222116adb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:54.109634 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.125778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaba4246-6bf1-4ae6-8cda-09a42bcef29e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7052c3b4-6884-48a3-8572-12e5ce4f034f,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:54.143349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aaba4246-6bf1-4ae6-8cda-09a42bcef29e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:54.143349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.021s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:54.150284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60788) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:54.166182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Pushing event deleted for resources: {'Network': ['ID=7c4246da-4773-4e75-9daa-b9c878c13272,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:54.169242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:54.174173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8efc991d-1af9-46d3-b626-ba7a22473ffc,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:54.174290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aaba4246-6bf1-4ae6-8cda-09a42bcef29e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.189396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:54.189579 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-aaba4246-6bf1-4ae6-8cda-09a42bcef29e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/7052c3b4-6884-48a3-8572-12e5ce4f034f HTTP/1.1" status: 204 len: 168 time: 0.3682609 Nov 11 11:41:54.194706 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] 10.222.0.11 "DELETE /v2.0/networks/7c4246da-4773-4e75-9daa-b9c878c13272 HTTP/1.1" status: 204 len: 168 time: 1.1840420 Nov 11 11:41:54.197071 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.210405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.227232 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/8efc991d-1af9-46d3-b626-ba7a22473ffc HTTP/1.1" status: 204 len: 168 time: 0.8013709 Nov 11 11:41:54.230202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60796) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:54.259023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:54.263364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Usage tracker for resource:security_group_rule and tenant:6aec526d345643dd990ae81dbf73c0dd is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:54.267325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:54.273578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:54.361405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.364131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.390380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.406934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-671791e8-2f4c-49fb-aaa2-0f2919a4e8dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:54.448740 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6aec526d345643dd990ae81dbf73c0dd&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2859693 Nov 11 11:41:54.451784 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60802) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:54.466016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01ff4acc-99bd-4e5e-9eb1-2785af97696a,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:54.469747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:54.504911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.529848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b64f2574-f1f5-4df8-bdc0-412cbc962cf0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.541031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['051d67c1-8621-4b80-95a5-4d8130e0d888']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:54.558233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:41:54.566512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b64f2574-f1f5-4df8-bdc0-412cbc962cf0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.574936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ddf57698-4593-4a1e-8a3e-eb5a836e5195') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:54.575528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ddf57698-4593-4a1e-8a3e-eb5a836e5195') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:41:54.597027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.621451 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.632983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Releasing vlan 1047 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:41:54.633581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:41:54.649146 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:41:54.661289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60808) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:54.688410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b64f2574-f1f5-4df8-bdc0-412cbc962cf0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.699791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0e7c0149-c52e-4e8d-a364-4466b7d69c45 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:54.761235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.767545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64f2574-f1f5-4df8-bdc0-412cbc962cf0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01ff4acc-99bd-4e5e-9eb1-2785af97696a,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:54.770896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3cdf3c0b-04d2-413c-b9ea-95ef206a7893 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:54.776876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b64f2574-f1f5-4df8-bdc0-412cbc962cf0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:54.795459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.811736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Pushing event deleted for resources: {'Network': ['ID=051d67c1-8621-4b80-95a5-4d8130e0d888,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:54.814451 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:54.816102 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1781649c-358a-463d-83c5-852369824b00 admin admin] 10.222.0.11 "DELETE /v2.0/networks/051d67c1-8621-4b80-95a5-4d8130e0d888 HTTP/1.1" status: 204 len: 168 time: 0.5840917 Nov 11 11:41:54.817859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b64f2574-f1f5-4df8-bdc0-412cbc962cf0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.819442 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b64f2574-f1f5-4df8-bdc0-412cbc962cf0 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/01ff4acc-99bd-4e5e-9eb1-2785af97696a HTTP/1.1" status: 204 len: 168 time: 0.3666153 Nov 11 11:41:54.835042 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-272962a5-f92e-4374-bf57-4b57be491d5f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=494d10266beb49e2a9a6952aeefc82ef&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1699555 Nov 11 11:41:54.835836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60820) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:54.898510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3025d9ed-450e-4d3d-a5d9-1b1ba37e2e26 req-a52df377-0c9b-40cc-97a2-db0c9b8ec973 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:54.900205 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3025d9ed-450e-4d3d-a5d9-1b1ba37e2e26 req-a52df377-0c9b-40cc-97a2-db0c9b8ec973 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1866317 Nov 11 11:41:54.958986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cb4aec9-3700-42e5-9b55-98f88e418191 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:54.991279 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3025d9ed-450e-4d3d-a5d9-1b1ba37e2e26 req-3f344a7c-09cc-4b53-8b91-dd1a5143f29f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831118 Nov 11 11:41:55.000111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cb4aec9-3700-42e5-9b55-98f88e418191 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:55.083102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cb4aec9-3700-42e5-9b55-98f88e418191 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:55.088920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fbbfda4b-81c0-4556-bc0d-5566f75c575d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:55.102753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb4aec9-3700-42e5-9b55-98f88e418191 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4ebddd5-d236-47a2-affc-c5ded3fd45d0,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:55.105594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9cb4aec9-3700-42e5-9b55-98f88e418191 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:55.154894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cb4aec9-3700-42e5-9b55-98f88e418191 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:55.156198 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9cb4aec9-3700-42e5-9b55-98f88e418191 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f4ebddd5-d236-47a2-affc-c5ded3fd45d0 HTTP/1.1" status: 204 len: 168 time: 0.3195126 Nov 11 11:41:55.162889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60832) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:55.255318 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e1da0bcd-8f83-4ab3-abfd-301723debc17 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ae132a17b438470b9d15c8bb6627a917&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0907841 Nov 11 11:41:55.258175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60836) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:55.331702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-981e47f3-9a87-4bc0-8071-4913acf38994 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:55.361207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-981e47f3-9a87-4bc0-8071-4913acf38994 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:55.453341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-981e47f3-9a87-4bc0-8071-4913acf38994 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:55.459002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-35dda9a0-fce3-4fc2-88a5-c945aca56562 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:55.470541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-981e47f3-9a87-4bc0-8071-4913acf38994 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7fbf0e2-1c24-4ae9-92dd-65bae85e727b,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:55.472877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-981e47f3-9a87-4bc0-8071-4913acf38994 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:55.478231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-981e47f3-9a87-4bc0-8071-4913acf38994 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:55.479581 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-981e47f3-9a87-4bc0-8071-4913acf38994 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b7fbf0e2-1c24-4ae9-92dd-65bae85e727b HTTP/1.1" status: 204 len: 168 time: 0.2202780 Nov 11 11:41:56.252840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bda0d3-55dd-467e-9ba2-556f38dee571 req-3d1297a2-3d25-4cd5-83b3-4f7437314965 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:56.254483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0bda0d3-55dd-467e-9ba2-556f38dee571 req-3d1297a2-3d25-4cd5-83b3-4f7437314965 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0900037 Nov 11 11:41:56.297371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60878) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:56.312305 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0bda0d3-55dd-467e-9ba2-556f38dee571 req-dd0aa6bb-b78e-4b2a-8fd4-78a8f6aa8542 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512021 Nov 11 11:41:56.372187 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-60bebfec-7882-4d4f-a89b-1a229935df4c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b1d5cec0bec340a987ba82c49230bc47&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0711367 Nov 11 11:41:56.372464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60884) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:56.450388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ad077664-ef1b-42d7-8e22-268e1f209a40 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:56.486128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ad077664-ef1b-42d7-8e22-268e1f209a40 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:56.600283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ad077664-ef1b-42d7-8e22-268e1f209a40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:56.606528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:56.618447 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad077664-ef1b-42d7-8e22-268e1f209a40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64a01972-3112-4627-81ec-526afd778409,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:56.624260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ad077664-ef1b-42d7-8e22-268e1f209a40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:56.626941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ad077664-ef1b-42d7-8e22-268e1f209a40 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:56.628253 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ad077664-ef1b-42d7-8e22-268e1f209a40 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/64a01972-3112-4627-81ec-526afd778409 HTTP/1.1" status: 204 len: 168 time: 0.2548082 Nov 11 11:41:57.624666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e25a2d3-a4e0-42ec-a87d-38072b30b3dd req-4b1d4031-0640-4131-aa52-546b561e2d17 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:57.626954 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8e25a2d3-a4e0-42ec-a87d-38072b30b3dd req-4b1d4031-0640-4131-aa52-546b561e2d17 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1594999 Nov 11 11:41:57.708978 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8e25a2d3-a4e0-42ec-a87d-38072b30b3dd req-d4a04a5e-9ce6-421f-a943-bf47879d8c87 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725138 Nov 11 11:41:57.739970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60938) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:58.109228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:58.143478 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:58.147458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Usage tracker for resource:security_group_rule and tenant:6ac356272968496abc50a44e9fc0e0e6 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:58.150452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:58.156561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:58.225345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:58.248534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:58.257889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:58.293396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47ee857a-67cf-43c1-9328-e5755f4ea6d2,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:58.303247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:58.313431 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6ac356272968496abc50a44e9fc0e0e6&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5716634 Nov 11 11:41:58.315849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 60956) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:58.389772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8552cadc-85d2-4d07-b887-377126306e90 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:58.417702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8552cadc-85d2-4d07-b887-377126306e90 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:58.502916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8552cadc-85d2-4d07-b887-377126306e90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:58.508358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e2f755d4-38ea-428b-a9d6-b3f3340693ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:58.527616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8552cadc-85d2-4d07-b887-377126306e90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47ee857a-67cf-43c1-9328-e5755f4ea6d2,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:58.535734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8552cadc-85d2-4d07-b887-377126306e90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:58.541361 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8552cadc-85d2-4d07-b887-377126306e90 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:58.544122 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8552cadc-85d2-4d07-b887-377126306e90 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/47ee857a-67cf-43c1-9328-e5755f4ea6d2 HTTP/1.1" status: 204 len: 168 time: 0.2263489 Nov 11 11:41:58.601767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 60970) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:58.930250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c48a6c-bf76-442f-a56b-780761356520 req-237e55ab-9baf-4870-a019-96ee832a38de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:41:58.945446 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f3c48a6c-bf76-442f-a56b-780761356520 req-237e55ab-9baf-4870-a019-96ee832a38de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1029046 Nov 11 11:41:58.999312 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f3c48a6c-bf76-442f-a56b-780761356520 req-09ba02b3-540b-4fec-914e-5261e711cf8d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529072 Nov 11 11:41:59.190438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.230017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:59.234322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Usage tracker for resource:security_group_rule and tenant:e9017f96e6a2463fa209e2be72f7abed is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:59.237459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:59.244147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:59.359703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.431470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.436166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-15567e8a-a03d-452e-9e44-5d18d3752f79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:59.486290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60ca57f6-e3f7-4f43-b9da-c6399a806166,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:59.500683 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:59.513013 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=e9017f96e6a2463fa209e2be72f7abed&name=default HTTP/1.1" status: 200 len: 2647 time: 0.9074819 Nov 11 11:41:59.513438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 32770) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:59.585902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99b0c808-383f-4e65-81cb-6dca8bee754f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.616072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99b0c808-383f-4e65-81cb-6dca8bee754f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.636455 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 32776) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:59.661982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.696778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:41:59.701149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Usage tracker for resource:security_group_rule and tenant:8200213d0f274343826f199ab9f242ce is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:41:59.704858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:41:59.711207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:41:59.720656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99b0c808-383f-4e65-81cb-6dca8bee754f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.734027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:59.753621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99b0c808-383f-4e65-81cb-6dca8bee754f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.758798 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-99b0c808-383f-4e65-81cb-6dca8bee754f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/60ca57f6-e3f7-4f43-b9da-c6399a806166 HTTP/1.1" status: 204 len: 168 time: 0.2442575 Nov 11 11:41:59.759953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99b0c808-383f-4e65-81cb-6dca8bee754f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60ca57f6-e3f7-4f43-b9da-c6399a806166,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:59.763046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-99b0c808-383f-4e65-81cb-6dca8bee754f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:59.786995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.820775 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.829467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:41:59.867945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7037c523-b411-4ab7-9d67-384399d14c70,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:41:59.873256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:41:59.887073 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=8200213d0f274343826f199ab9f242ce&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2450993 Nov 11 11:41:59.887073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 32788) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:41:59.952874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3e92e3bf-3de8-4e10-94ca-430825a0cd93 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:41:59.981352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3e92e3bf-3de8-4e10-94ca-430825a0cd93 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:00.066103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3e92e3bf-3de8-4e10-94ca-430825a0cd93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:00.072658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:00.097260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e92e3bf-3de8-4e10-94ca-430825a0cd93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7037c523-b411-4ab7-9d67-384399d14c70,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:00.102443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3e92e3bf-3de8-4e10-94ca-430825a0cd93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:00.142697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3e92e3bf-3de8-4e10-94ca-430825a0cd93 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:00.144075 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3e92e3bf-3de8-4e10-94ca-430825a0cd93 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/7037c523-b411-4ab7-9d67-384399d14c70 HTTP/1.1" status: 204 len: 168 time: 0.2597361 Nov 11 11:42:00.238595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2dc3fe7-c331-4877-bc2b-27b7142c5463 req-1e526050-6a56-4530-8cdc-9367f81c2860 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:00.240318 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e2dc3fe7-c331-4877-bc2b-27b7142c5463 req-1e526050-6a56-4530-8cdc-9367f81c2860 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0951524 Nov 11 11:42:00.292802 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e2dc3fe7-c331-4877-bc2b-27b7142c5463 req-a2adf7ec-9f11-4a49-98d6-872e9e919ad4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447888 Nov 11 11:42:01.589545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57df041f-2a80-474e-9b80-c9a338c8282d req-aa353de9-f010-40ae-920b-d322ad479ac7 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:01.592197 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-57df041f-2a80-474e-9b80-c9a338c8282d req-aa353de9-f010-40ae-920b-d322ad479ac7 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1210804 Nov 11 11:42:01.659740 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-57df041f-2a80-474e-9b80-c9a338c8282d req-0f206f90-e846-421e-9d04-f7d715c2732e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599024 Nov 11 11:42:02.923745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b16b9597-58a0-4ba3-8a85-aec54ed6f53d req-e49baeb0-5ee1-43d3-92bb-58e0a0e0c507 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:02.925404 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b16b9597-58a0-4ba3-8a85-aec54ed6f53d req-e49baeb0-5ee1-43d3-92bb-58e0a0e0c507 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1161687 Nov 11 11:42:02.982084 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b16b9597-58a0-4ba3-8a85-aec54ed6f53d req-eac6a2e5-ec1a-40cc-b1b6-5d234c06190e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496588 Nov 11 11:42:04.214313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1143e33-125d-4307-8081-0027e7c027bf req-075faf04-9153-42cf-b6db-c5030786415c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:04.216723 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c1143e33-125d-4307-8081-0027e7c027bf req-075faf04-9153-42cf-b6db-c5030786415c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1017258 Nov 11 11:42:04.273887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c1143e33-125d-4307-8081-0027e7c027bf req-83e2d475-b5f7-478d-bd87-e85f66b9e0a6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503001 Nov 11 11:42:04.470920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:05.492775 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a625d9-f52b-4209-a4f9-ec00d31127c8 req-dec24b96-fca1-4119-b91a-464f2de94341 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:05.494354 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-03a625d9-f52b-4209-a4f9-ec00d31127c8 req-dec24b96-fca1-4119-b91a-464f2de94341 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0903487 Nov 11 11:42:05.551311 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-03a625d9-f52b-4209-a4f9-ec00d31127c8 req-55496440-44a7-44b4-9026-a3fb68e92b94 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506246 Nov 11 11:42:06.647063 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-44c045ce-fdcb-4994-b0f7-01bf37ecdccd service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1193676 Nov 11 11:42:06.858233 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-c3c7bf6e-b260-48bb-a9f3-8fad1e564a3b service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 1099 time: 0.1065183 Nov 11 11:42:06.887177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed577f74-af2b-4142-94c9-365bf17169ee req-c41fa990-4af5-4251-b63b-f0f8620841e9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:06.888837 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed577f74-af2b-4142-94c9-365bf17169ee req-c41fa990-4af5-4251-b63b-f0f8620841e9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1868205 Nov 11 11:42:07.095318 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed577f74-af2b-4142-94c9-365bf17169ee req-315223ff-57ba-42da-8d23-60e03b979072 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664697 Nov 11 11:42:07.102608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-179dd925-cd3b-48e5-a70f-9ec1196aaccd service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:07.104234 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-179dd925-cd3b-48e5-a70f-9ec1196aaccd service neutron] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 913 time: 0.2144461 Nov 11 11:42:07.244302 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-bee00104-960b-4163-bd84-7866947bd737 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c HTTP/1.1" status: 200 len: 1001 time: 0.1230214 Nov 11 11:42:07.263227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33128) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:07.374120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-102ba3c2-4568-4daa-8538-739a46de8254 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:07.375904 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-102ba3c2-4568-4daa-8538-739a46de8254 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.1226921 Nov 11 11:42:07.468784 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-bab89332-ef11-4e08-9446-b03ac3dd6a1f service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0839322 Nov 11 11:42:07.505333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:07.614120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:07.614120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Usage tracker for resource:security_group_rule and tenant:87728ac4c7814652b9d83ac4ee8ab7db is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:07.614120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:07.614120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:07.683160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:07.684160 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-dd8c4af5-5c3d-40be-a804-ff30b80b6219 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2078640 Nov 11 11:42:07.743226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:07.751985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:07.798016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=353ba3fb-9fc9-48be-9ccf-ce677c609b3b,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:07.802616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:07.808606 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=87728ac4c7814652b9d83ac4ee8ab7db&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5444381 Nov 11 11:42:07.809448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33146) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:07.864035 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75354321-e60c-447e-8ea7-6acd2b16b869 req-ed238e9b-0543-494c-b1f4-e90e837d39e0 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1729677 Nov 11 11:42:07.885399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c84b3c3e-be81-408b-9971-2e81a190c1a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:07.914071 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c84b3c3e-be81-408b-9971-2e81a190c1a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:08.140317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c84b3c3e-be81-408b-9971-2e81a190c1a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:08.150481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bf261aca-5616-41be-9151-e55121f2884a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:08.167031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c84b3c3e-be81-408b-9971-2e81a190c1a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=353ba3fb-9fc9-48be-9ccf-ce677c609b3b,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:08.170561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c84b3c3e-be81-408b-9971-2e81a190c1a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:08.172235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c84b3c3e-be81-408b-9971-2e81a190c1a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:08.173940 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c84b3c3e-be81-408b-9971-2e81a190c1a1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/353ba3fb-9fc9-48be-9ccf-ce677c609b3b HTTP/1.1" status: 204 len: 168 time: 0.3628786 Nov 11 11:42:08.364226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9e2e0d-71de-477a-a0f0-5a39e46641b1 req-1af4737e-1c51-46c5-bea7-89d129afb55b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:08.365834 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa9e2e0d-71de-477a-a0f0-5a39e46641b1 req-1af4737e-1c51-46c5-bea7-89d129afb55b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0999577 Nov 11 11:42:08.416074 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa9e2e0d-71de-477a-a0f0-5a39e46641b1 req-3605d938-9a52-42cc-a2a4-884b056a7db9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441039 Nov 11 11:42:08.744292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33168) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:08.764880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:08.803455 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:08.810584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Usage tracker for resource:security_group_rule and tenant:bcbc3ee3dca9410c918229e2fea4f1cb is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:08.810922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:08.817160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:08.892256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:08.934570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:08.945379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a72783f6-5253-45c5-be19-e641e18f8a76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:08.991197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c737437-f67d-418c-975d-d51e6d45f929,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:08.994611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:08.997268 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bcbc3ee3dca9410c918229e2fea4f1cb&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2517183 Nov 11 11:42:09.001075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33182) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:09.079780 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d21ba46d-9882-4032-a5ef-bb16fe757331 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:09.107719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d21ba46d-9882-4032-a5ef-bb16fe757331 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:09.195376 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d21ba46d-9882-4032-a5ef-bb16fe757331 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:09.200876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7bb88f82-f323-471c-82d8-8a5626b3995d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:09.215185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21ba46d-9882-4032-a5ef-bb16fe757331 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c737437-f67d-418c-975d-d51e6d45f929,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:09.217663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d21ba46d-9882-4032-a5ef-bb16fe757331 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:09.228280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d21ba46d-9882-4032-a5ef-bb16fe757331 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:09.234281 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d21ba46d-9882-4032-a5ef-bb16fe757331 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2c737437-f67d-418c-975d-d51e6d45f929 HTTP/1.1" status: 204 len: 168 time: 0.2313950 Nov 11 11:42:09.671517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e43f917-40ac-4567-b0fb-28ace731e94e req-7ec1c93c-4a8f-41ca-a27c-20087acfd8ad tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:09.673580 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9e43f917-40ac-4567-b0fb-28ace731e94e req-7ec1c93c-4a8f-41ca-a27c-20087acfd8ad tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1125157 Nov 11 11:42:09.740080 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9e43f917-40ac-4567-b0fb-28ace731e94e req-b6320e3d-eacc-41bd-a43c-a9a37c6bad12 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580494 Nov 11 11:42:10.027696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5026b314-3f4b-4760-a2bd-84c4e2ba635f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:10.963485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a36f885-fdac-46c7-b9f7-c2a5f01be013 req-62dc67e1-9b60-4ed5-b3e1-ab5372cda4d7 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:10.965353 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5a36f885-fdac-46c7-b9f7-c2a5f01be013 req-62dc67e1-9b60-4ed5-b3e1-ab5372cda4d7 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0923004 Nov 11 11:42:11.024978 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5a36f885-fdac-46c7-b9f7-c2a5f01be013 req-d83381ff-c5ee-48cb-814c-17c4b069a73d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519879 Nov 11 11:42:11.277252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:12.259652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880128fc-a07d-48bb-b3c2-0509beac8789 req-5671be78-6f7b-4e2e-a3ed-b0b41cfc54a2 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:12.261244 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-880128fc-a07d-48bb-b3c2-0509beac8789 req-5671be78-6f7b-4e2e-a3ed-b0b41cfc54a2 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0870237 Nov 11 11:42:12.313649 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-880128fc-a07d-48bb-b3c2-0509beac8789 req-26e21724-7251-4554-bf75-fd850364979e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457773 Nov 11 11:42:13.417211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33318) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:13.477091 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-76ed3902-0dbe-455d-9d26-0b0fbd6afe1f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:13.505836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:13.591515 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:13.594470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ca39c9-cd60-4b49-a7e7-9bd6d0017a37 req-b5d8d0d4-8422-4353-84c8-1a703f5a2ef7 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:13.596462 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f5ca39c9-cd60-4b49-a7e7-9bd6d0017a37 req-b5d8d0d4-8422-4353-84c8-1a703f5a2ef7 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1269426 Nov 11 11:42:13.628388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:13.633383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Usage tracker for resource:security_group_rule and tenant:f78f89464dc8422fb633c667d433fc36 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:13.636735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:13.643134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:13.653086 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f5ca39c9-cd60-4b49-a7e7-9bd6d0017a37 req-56bb459b-77ab-4654-8e1e-d10d688f844f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483265 Nov 11 11:42:13.718944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:13.774861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:13.783977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-499d3110-f07e-4e23-9f45-9177d41459d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:13.830899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=680f1d44-4cbc-4621-85a6-b0b66ae49012,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:13.837240 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f78f89464dc8422fb633c667d433fc36&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4189172 Nov 11 11:42:13.840149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33330) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:13.843830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.844242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.844675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.845074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.845472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.845867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.846258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.846670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.847064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.847479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.848181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:13.851870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:13.904643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:13.938571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:14.014645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:14.021128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aeeead8d-e304-421d-b09a-3c821baff5f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:14.037181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=680f1d44-4cbc-4621-85a6-b0b66ae49012,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:14.047130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:14.048389 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/680f1d44-4cbc-4621-85a6-b0b66ae49012 HTTP/1.1" status: 204 len: 168 time: 0.2071664 Nov 11 11:42:14.050488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.050488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.050934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.051420 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.051823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.052567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.052567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.052945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.053335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.053744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.054075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:14.059270 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:14.622817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:14.910219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74caef85-8644-40fe-a83d-eb9e9419dc80 req-7128ab30-49b2-4734-b880-199c7b97167d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:14.912033 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74caef85-8644-40fe-a83d-eb9e9419dc80 req-7128ab30-49b2-4734-b880-199c7b97167d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0925796 Nov 11 11:42:14.964110 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74caef85-8644-40fe-a83d-eb9e9419dc80 req-49662653-5dc4-4b45-b728-2e0e6e6c64b2 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459108 Nov 11 11:42:15.922130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33404) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:16.141357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:16.173946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:16.177996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Usage tracker for resource:security_group_rule and tenant:b5d4daeeda094ac88ca6e9824afca2d9 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:16.181312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:16.187743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:16.259346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:16.325745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:16.334549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5cf7b800-e973-4d25-9c6f-b06ff933390f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:16.382146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0746a2fa-a5bb-4d19-9294-caea3c671747,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:16.385349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:16.388223 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b5d4daeeda094ac88ca6e9824afca2d9&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4644990 Nov 11 11:42:16.390934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33422) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:16.454742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-913dc368-e839-4906-bd0f-77e1514561f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:16.482507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-913dc368-e839-4906-bd0f-77e1514561f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:16.563547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-913dc368-e839-4906-bd0f-77e1514561f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:16.569178 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ce5ea998-3589-473a-bfa3-069faf2c34d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:16.582989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913dc368-e839-4906-bd0f-77e1514561f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0746a2fa-a5bb-4d19-9294-caea3c671747,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:16.587655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-913dc368-e839-4906-bd0f-77e1514561f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:16.588577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-913dc368-e839-4906-bd0f-77e1514561f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:16.592542 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-913dc368-e839-4906-bd0f-77e1514561f2 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0746a2fa-a5bb-4d19-9294-caea3c671747 HTTP/1.1" status: 204 len: 168 time: 0.1978095 Nov 11 11:42:16.862069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33434) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:17.017642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.052429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:17.056642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Usage tracker for resource:security_group_rule and tenant:9ff5fb5836f747388242b03d53a5a1f9 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:17.059617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:17.065778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:17.123216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33444) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:17.136822 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.143752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.177444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:17.181507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Usage tracker for resource:security_group_rule and tenant:4fc185c6647c4ddba530f24e4a6c7fc6 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:17.184727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:17.190925 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:17.191186 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.199013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5d5f73de-7fe6-4435-9940-a927ab5d6390 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:17.270472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.297708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.306404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:17.353070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47da2a13-0342-4aea-ab2e-da47773ce4de,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:17.357916 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4fc185c6647c4ddba530f24e4a6c7fc6&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2335274 Nov 11 11:42:17.358943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:17.360706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33450) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:17.426850 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-607868ad-7492-4dc5-8913-fb6a4f05e285 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.439015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69091a9e-c868-4be0-acd8-d6bc8a5ddca8,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:17.442338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:17.445419 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9ff5fb5836f747388242b03d53a5a1f9&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5822301 Nov 11 11:42:17.452703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33454) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:17.462149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-607868ad-7492-4dc5-8913-fb6a4f05e285 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.518306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-091be997-b6ad-4a2e-9e01-b150154c9076 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.536794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-607868ad-7492-4dc5-8913-fb6a4f05e285 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.543235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ba5537f0-546c-4988-ab16-01732eea479b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:17.547994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-091be997-b6ad-4a2e-9e01-b150154c9076 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.559202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607868ad-7492-4dc5-8913-fb6a4f05e285 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47da2a13-0342-4aea-ab2e-da47773ce4de,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:17.563056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-607868ad-7492-4dc5-8913-fb6a4f05e285 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:17.567676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-607868ad-7492-4dc5-8913-fb6a4f05e285 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.571933 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-607868ad-7492-4dc5-8913-fb6a4f05e285 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/47da2a13-0342-4aea-ab2e-da47773ce4de HTTP/1.1" status: 204 len: 168 time: 0.2102363 Nov 11 11:42:17.659717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-091be997-b6ad-4a2e-9e01-b150154c9076 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.665107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:17.677933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091be997-b6ad-4a2e-9e01-b150154c9076 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69091a9e-c868-4be0-acd8-d6bc8a5ddca8,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:17.681088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-091be997-b6ad-4a2e-9e01-b150154c9076 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:17.683125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-091be997-b6ad-4a2e-9e01-b150154c9076 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:17.687928 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-091be997-b6ad-4a2e-9e01-b150154c9076 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/69091a9e-c868-4be0-acd8-d6bc8a5ddca8 HTTP/1.1" status: 204 len: 168 time: 0.2304394 Nov 11 11:42:18.348292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33472) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:18.368996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.387916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33476) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:18.423788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:18.426292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.438310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Usage tracker for resource:security_group_rule and tenant:4e4c5de4cf4e4d0890f749678d53937e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:18.442496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:18.452289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:18.485771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:18.492761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Usage tracker for resource:security_group_rule and tenant:e5baadf1d4f34c96b73e0223cce613fe is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:18.498911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:18.506520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:18.672538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.712221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.720958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.722575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b64f2574-f1f5-4df8-bdc0-412cbc962cf0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:18.760176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.773219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ccb8cb6a-4085-41c9-a9a5-07984331ccd8,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:18.778534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:18.779201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3e92e3bf-3de8-4e10-94ca-430825a0cd93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.008s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:18.788092 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4e4c5de4cf4e4d0890f749678d53937e&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4386947 Nov 11 11:42:18.791198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33480) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:18.819915 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=e5baadf1d4f34c96b73e0223cce613fe&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4250298 Nov 11 11:42:18.823005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33484) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:18.840505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=110eac32-0ca3-406b-bedb-f1c5c9d3e7b0,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:18.845453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:18.861384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6e0ad634-308d-44a2-a941-b3b8271e8026 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.888147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6e0ad634-308d-44a2-a941-b3b8271e8026 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.895009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d8044fd-3ef0-4d31-b14c-43777ea1fb18 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.922473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d8044fd-3ef0-4d31-b14c-43777ea1fb18 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.982767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6e0ad634-308d-44a2-a941-b3b8271e8026 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:18.986946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d21ba46d-9882-4032-a5ef-bb16fe757331 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:18.999874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e0ad634-308d-44a2-a941-b3b8271e8026 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccb8cb6a-4085-41c9-a9a5-07984331ccd8,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:19.002558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6e0ad634-308d-44a2-a941-b3b8271e8026 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:19.005869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d8044fd-3ef0-4d31-b14c-43777ea1fb18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:19.009314 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6e0ad634-308d-44a2-a941-b3b8271e8026 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:19.011854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-091be997-b6ad-4a2e-9e01-b150154c9076 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:19.016708 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6e0ad634-308d-44a2-a941-b3b8271e8026 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ccb8cb6a-4085-41c9-a9a5-07984331ccd8 HTTP/1.1" status: 204 len: 168 time: 0.2211497 Nov 11 11:42:19.026345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8044fd-3ef0-4d31-b14c-43777ea1fb18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=110eac32-0ca3-406b-bedb-f1c5c9d3e7b0,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:19.030581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5d8044fd-3ef0-4d31-b14c-43777ea1fb18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:19.036334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d8044fd-3ef0-4d31-b14c-43777ea1fb18 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:19.037422 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5d8044fd-3ef0-4d31-b14c-43777ea1fb18 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/110eac32-0ca3-406b-bedb-f1c5c9d3e7b0 HTTP/1.1" status: 204 len: 168 time: 0.2136605 Nov 11 11:42:20.001972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dfcee67-8eb1-4cfc-b8b8-9b70ddf388be req-f99f9990-a203-4316-9338-20dbd8fa324c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:20.004098 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3dfcee67-8eb1-4cfc-b8b8-9b70ddf388be req-f99f9990-a203-4316-9338-20dbd8fa324c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1004214 Nov 11 11:42:20.059658 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3dfcee67-8eb1-4cfc-b8b8-9b70ddf388be req-8d44ed6d-3bf0-4f04-9eb1-7766d51f2399 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475225 Nov 11 11:42:21.357822 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f0786632-c87c-4435-b42d-cd4b47127140 req-96b214d2-370a-4da7-8d03-0b5df1343536 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 1098 time: 0.1618187 Nov 11 11:42:21.385426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e6592f7-0820-479a-b317-54a4a2fbd1ee req-e01cd176-449c-4ff2-bd9c-f6d848c9cf1b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:21.386410 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3e6592f7-0820-479a-b317-54a4a2fbd1ee req-e01cd176-449c-4ff2-bd9c-f6d848c9cf1b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1250064 Nov 11 11:42:21.477701 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3e6592f7-0820-479a-b317-54a4a2fbd1ee req-800f8686-4758-4d73-9e0a-5bf4d6e37300 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834460 Nov 11 11:42:22.492863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33616) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:22.659705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:22.692417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:22.696390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Usage tracker for resource:security_group_rule and tenant:6f167bb34a9b46c0ab150455fa351ab1 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:22.699358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:22.705366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:22.774650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:22.825185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:22.834612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:22.880459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a859b77a-6d98-4cf3-9137-0bc3ef0d1fed,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:22.892208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:22.899311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33634) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:22.903859 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6f167bb34a9b46c0ab150455fa351ab1&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4096980 Nov 11 11:42:22.968700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b87ee36a-b494-47f3-aaae-a96203367d98 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:22.996101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b87ee36a-b494-47f3-aaae-a96203367d98 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:23.119838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b87ee36a-b494-47f3-aaae-a96203367d98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:23.125110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-99b0c808-383f-4e65-81cb-6dca8bee754f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:23.137718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b87ee36a-b494-47f3-aaae-a96203367d98 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a859b77a-6d98-4cf3-9137-0bc3ef0d1fed,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:23.142052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b87ee36a-b494-47f3-aaae-a96203367d98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:23.144610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b87ee36a-b494-47f3-aaae-a96203367d98 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:23.146229 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b87ee36a-b494-47f3-aaae-a96203367d98 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/a859b77a-6d98-4cf3-9137-0bc3ef0d1fed HTTP/1.1" status: 204 len: 168 time: 0.2456863 Nov 11 11:42:23.336734 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f0786632-c87c-4435-b42d-cd4b47127140 req-98d4d17a-887c-49b9-9580-02ee5b2abb43 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441196 Nov 11 11:42:23.652871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33642) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:23.672617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:23.705820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:23.710051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Usage tracker for resource:security_group_rule and tenant:479dc5b9f6c34ef19b1ec8f7d7932fef is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:23.713273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:23.719407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:23.787565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:23.830838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:23.839211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-913dc368-e839-4906-bd0f-77e1514561f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:23.881268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd7fac4b-c333-482f-8231-a90db4deaeac,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:23.886724 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=479dc5b9f6c34ef19b1ec8f7d7932fef&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2327180 Nov 11 11:42:23.887874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a9aebead-9bb4-4389-a9a5-5e81630e3863 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:23.889620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33652) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:23.960911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-684ea647-39b5-405a-ae49-e0b0b54c6679 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:23.988289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-684ea647-39b5-405a-ae49-e0b0b54c6679 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:24.065571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-684ea647-39b5-405a-ae49-e0b0b54c6679 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:24.070963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0d3edce9-e57f-4183-b43e-8f0fea810061 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:24.087088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-684ea647-39b5-405a-ae49-e0b0b54c6679 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd7fac4b-c333-482f-8231-a90db4deaeac,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:24.090253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-684ea647-39b5-405a-ae49-e0b0b54c6679 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:24.092266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-684ea647-39b5-405a-ae49-e0b0b54c6679 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:24.093466 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-684ea647-39b5-405a-ae49-e0b0b54c6679 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/dd7fac4b-c333-482f-8231-a90db4deaeac HTTP/1.1" status: 204 len: 168 time: 0.2025046 Nov 11 11:42:25.832523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6745b76-9574-4b1f-984c-d1c1ceaa3361 req-e9487ba7-28cb-49e5-b653-f73bbda2a851 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:25.834056 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c6745b76-9574-4b1f-984c-d1c1ceaa3361 req-e9487ba7-28cb-49e5-b653-f73bbda2a851 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0888765 Nov 11 11:42:25.895099 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c6745b76-9574-4b1f-984c-d1c1ceaa3361 req-5005750a-b4b6-4c99-b1b9-29d81593a003 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544286 Nov 11 11:42:27.119082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebbb93e-3bb6-47b6-a000-a2817bee649e req-f2309d54-ad92-4d9b-a2c0-99c120a0996a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:27.120638 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7ebbb93e-3bb6-47b6-a000-a2817bee649e req-f2309d54-ad92-4d9b-a2c0-99c120a0996a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0919952 Nov 11 11:42:27.128987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33746) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:27.198779 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7ebbb93e-3bb6-47b6-a000-a2817bee649e req-c27f5aa9-29ba-47d2-bb94-1d107709f7cf tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537210 Nov 11 11:42:27.315321 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:27.366003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:27.370171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Usage tracker for resource:security_group_rule and tenant:5022e86be409459e84586b676a7c2eae is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:27.373127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:27.379350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:27.451476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:27.520409 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:27.528102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6e0ad634-308d-44a2-a941-b3b8271e8026 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:27.573673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=750f0897-26a2-47ff-a7ee-1e13ab3c84a4,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:27.576837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:27.586217 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5022e86be409459e84586b676a7c2eae&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4557931 Nov 11 11:42:27.591041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33758) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:27.658853 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b68af4ca-3135-421f-ba87-d1e402b0f71e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:27.692356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b68af4ca-3135-421f-ba87-d1e402b0f71e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:27.771252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b68af4ca-3135-421f-ba87-d1e402b0f71e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:27.776493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d1b9ef2e-44fe-4801-bdeb-baf981f8b871 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:27.790351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b68af4ca-3135-421f-ba87-d1e402b0f71e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=750f0897-26a2-47ff-a7ee-1e13ab3c84a4,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:27.793152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b68af4ca-3135-421f-ba87-d1e402b0f71e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:27.808581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b68af4ca-3135-421f-ba87-d1e402b0f71e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:27.813594 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b68af4ca-3135-421f-ba87-d1e402b0f71e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/750f0897-26a2-47ff-a7ee-1e13ab3c84a4 HTTP/1.1" status: 204 len: 168 time: 0.2229986 Nov 11 11:42:28.326244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33778) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:28.347258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:28.391467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:28.396246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Usage tracker for resource:security_group_rule and tenant:265dc0e132fe487faa5b2b0b4ddb8242 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:28.399668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:28.406111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:28.412610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82fb8bd-96f6-4b20-88d6-5d9518faa0d0 req-1ffdeec9-a5f9-4e9f-83c5-385f4ece815e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:28.414521 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c82fb8bd-96f6-4b20-88d6-5d9518faa0d0 req-1ffdeec9-a5f9-4e9f-83c5-385f4ece815e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.0870397 Nov 11 11:42:28.466887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c82fb8bd-96f6-4b20-88d6-5d9518faa0d0 req-7e4af5dd-8523-4e7d-b376-f11a90ac60fb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449190 Nov 11 11:42:28.482417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:28.529662 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:28.543913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aaba4246-6bf1-4ae6-8cda-09a42bcef29e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:28.613746 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=265dc0e132fe487faa5b2b0b4ddb8242&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2837994 Nov 11 11:42:28.613746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20cdf6f3-6dcd-42eb-9c9e-6b3a092082ee,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:28.615309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33790) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:28.615603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:28.751887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33796) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:28.766719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-926dbb12-2f92-4bec-8e94-dc1719724c67 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:28.782818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd83525-8987-4fa9-b63d-a76a52a11b02 req-64a23a7a-0827-47b1-8a3a-1904519ce35a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:28.784476 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9fd83525-8987-4fa9-b63d-a76a52a11b02 req-64a23a7a-0827-47b1-8a3a-1904519ce35a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1399949 Nov 11 11:42:28.821065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-926dbb12-2f92-4bec-8e94-dc1719724c67 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:28.869981 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9fd83525-8987-4fa9-b63d-a76a52a11b02 req-94c76a83-4a23-4d8b-986f-05a6fc6ce16a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726368 Nov 11 11:42:28.941021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:28.942995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-926dbb12-2f92-4bec-8e94-dc1719724c67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:28.948633 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-644618c2-626d-4267-be14-ed94ff42dbf6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:28.961410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-926dbb12-2f92-4bec-8e94-dc1719724c67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20cdf6f3-6dcd-42eb-9c9e-6b3a092082ee,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:28.964667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-926dbb12-2f92-4bec-8e94-dc1719724c67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:28.972557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-926dbb12-2f92-4bec-8e94-dc1719724c67 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:28.973545 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-926dbb12-2f92-4bec-8e94-dc1719724c67 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/20cdf6f3-6dcd-42eb-9c9e-6b3a092082ee HTTP/1.1" status: 204 len: 168 time: 0.3566642 Nov 11 11:42:28.981165 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:28.986368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Usage tracker for resource:security_group_rule and tenant:0915d8c2b8594743900dfcd393cb2ba9 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:28.990232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:29.003106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:29.082951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:29.113707 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:29.122291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-981e47f3-9a87-4bc0-8071-4913acf38994 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:29.170001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f08de9ea-9f0d-44bd-b091-84335f202a3a,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:29.177951 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=0915d8c2b8594743900dfcd393cb2ba9&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4248877 Nov 11 11:42:29.178122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33814) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:29.179174 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:29.261741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92e77932-775f-40aa-a69e-34dd5248e040 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:29.289901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92e77932-775f-40aa-a69e-34dd5248e040 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:29.373548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92e77932-775f-40aa-a69e-34dd5248e040 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:29.381406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:29.392299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e77932-775f-40aa-a69e-34dd5248e040 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f08de9ea-9f0d-44bd-b091-84335f202a3a,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:29.395549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-92e77932-775f-40aa-a69e-34dd5248e040 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:29.397838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92e77932-775f-40aa-a69e-34dd5248e040 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:29.399002 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-92e77932-775f-40aa-a69e-34dd5248e040 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f08de9ea-9f0d-44bd-b091-84335f202a3a HTTP/1.1" status: 204 len: 168 time: 0.2187662 Nov 11 11:42:29.998962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 33844) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:30.019709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:30.054492 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:30.058552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Usage tracker for resource:security_group_rule and tenant:7106f762ed934f33ab7a8eb4134caad2 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:30.061824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:30.068218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:30.145835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:30.180184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:30.190160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8b5dd6ca-4edd-4342-b09e-a8d86b85a3c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:30.243340 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7106f762ed934f33ab7a8eb4134caad2&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2406700 Nov 11 11:42:30.243340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=425df7c6-6534-4b45-a58b-821677c8aef5,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:30.243923 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33858) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:30.245230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:30.329211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b84903b9-eb37-466f-b6f5-f363a094b245 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:30.358882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b84903b9-eb37-466f-b6f5-f363a094b245 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:30.442406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b84903b9-eb37-466f-b6f5-f363a094b245 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:30.447824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ad077664-ef1b-42d7-8e22-268e1f209a40 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:30.462668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b84903b9-eb37-466f-b6f5-f363a094b245 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=425df7c6-6534-4b45-a58b-821677c8aef5,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:30.465167 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b84903b9-eb37-466f-b6f5-f363a094b245 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:30.486076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b84903b9-eb37-466f-b6f5-f363a094b245 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:30.490158 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b84903b9-eb37-466f-b6f5-f363a094b245 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/425df7c6-6534-4b45-a58b-821677c8aef5 HTTP/1.1" status: 204 len: 168 time: 0.2422149 Nov 11 11:42:31.568553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:42:32.531826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33962) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:32.698667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:32.732385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:32.737152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Usage tracker for resource:security_group_rule and tenant:1af76ec2a97f42fcb5f3171cea434456 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:32.740064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:32.745989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:32.813509 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:32.841811 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:32.850475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-adfd8a8c-32e7-40ce-bf21-dbf3eb4dc834 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:32.893669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee5220dd-2a29-49e1-b942-3e39764caffc,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:32.896788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:32.899746 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=1af76ec2a97f42fcb5f3171cea434456&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3668394 Nov 11 11:42:32.902618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 33970) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:32.970940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-527f458e-21bf-442b-9917-0eea1ac0a74b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:32.997480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-527f458e-21bf-442b-9917-0eea1ac0a74b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:33.085326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-527f458e-21bf-442b-9917-0eea1ac0a74b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:33.090911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f0f32e67-7d0b-45a7-a02b-9374a4169582 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:33.104463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-527f458e-21bf-442b-9917-0eea1ac0a74b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee5220dd-2a29-49e1-b942-3e39764caffc,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:33.107612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-527f458e-21bf-442b-9917-0eea1ac0a74b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:33.109663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-527f458e-21bf-442b-9917-0eea1ac0a74b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:33.111206 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-527f458e-21bf-442b-9917-0eea1ac0a74b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ee5220dd-2a29-49e1-b942-3e39764caffc HTTP/1.1" status: 204 len: 168 time: 0.2071381 Nov 11 11:42:34.503604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:34.747866 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-23997d86-7dfa-485b-8013-391bbf964c66 req-b5c17aa9-131b-44ca-942b-424ad3c7a88c service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1098 time: 0.1650290 Nov 11 11:42:34.889277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f18d891-b0b2-4be9-a3b2-4ea4d4589e4c req-d60244d3-69c3-48c6-b492-69af2bf84a23 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:34.893338 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5f18d891-b0b2-4be9-a3b2-4ea4d4589e4c req-d60244d3-69c3-48c6-b492-69af2bf84a23 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.2298555 Nov 11 11:42:34.975122 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5f18d891-b0b2-4be9-a3b2-4ea4d4589e4c req-e7400209-3e64-4c2a-91a9-d0f59333fdd9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712588 Nov 11 11:42:34.982571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23997d86-7dfa-485b-8013-391bbf964c66 req-eb8f5a6d-1163-478f-8062-ea9877fcbdc5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:34.984719 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-23997d86-7dfa-485b-8013-391bbf964c66 req-eb8f5a6d-1163-478f-8062-ea9877fcbdc5 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.2297597 Nov 11 11:42:35.063733 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-23997d86-7dfa-485b-8013-391bbf964c66 req-368127da-ada4-4b42-ba92-5667d26d7054 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 200 len: 217 time: 0.0715966 Nov 11 11:42:35.140631 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23997d86-7dfa-485b-8013-391bbf964c66 req-84f2f92b-2c8a-4908-81b1-724431fb70fb service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:35.142239 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-23997d86-7dfa-485b-8013-391bbf964c66 req-84f2f92b-2c8a-4908-81b1-724431fb70fb service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.0722187 Nov 11 11:42:35.193002 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-23997d86-7dfa-485b-8013-391bbf964c66 req-864e9c80-37c5-4079-b28d-ea72c255b00c service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0441206 Nov 11 11:42:35.356922 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-23997d86-7dfa-485b-8013-391bbf964c66 req-59376353-7f19-432a-8549-d64bbe47b78f service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1567144 Nov 11 11:42:35.508605 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-23997d86-7dfa-485b-8013-391bbf964c66 req-b46448d6-cc59-4421-88dd-2aa0e5354beb service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1440914 Nov 11 11:42:36.199163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8379f5be-7bc6-4755-a40b-df406e478454 req-2f74d811-2651-4fb3-aa24-6b61a20f1ad4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:36.200886 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8379f5be-7bc6-4755-a40b-df406e478454 req-2f74d811-2651-4fb3-aa24-6b61a20f1ad4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0950921 Nov 11 11:42:36.254489 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8379f5be-7bc6-4755-a40b-df406e478454 req-549bd557-e341-4d68-b0b2-583dd599f778 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476022 Nov 11 11:42:36.423741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34128) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:36.593782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:36.632658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:36.636700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Usage tracker for resource:security_group_rule and tenant:c872b2e262ac472791349788910cfbc6 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:36.640150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:36.646177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:36.714940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:36.768323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:36.776525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d9671ef0-cb8b-4a07-9a53-683bbb438e3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:36.823553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd469b7a-2056-4717-b7eb-52e722ddc96e,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:36.827206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:36.832590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34138) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:36.832736 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c872b2e262ac472791349788910cfbc6&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4076979 Nov 11 11:42:36.903938 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-45af2619-fa94-4a1c-bed4-2b6a903a6bb4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:36.933611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-45af2619-fa94-4a1c-bed4-2b6a903a6bb4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.042012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-45af2619-fa94-4a1c-bed4-2b6a903a6bb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.047911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-48520199-d6d7-4625-be6a-7085b1576b6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:37.060708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45af2619-fa94-4a1c-bed4-2b6a903a6bb4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd469b7a-2056-4717-b7eb-52e722ddc96e,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:37.065443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-45af2619-fa94-4a1c-bed4-2b6a903a6bb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:37.072027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-45af2619-fa94-4a1c-bed4-2b6a903a6bb4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.073230 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-45af2619-fa94-4a1c-bed4-2b6a903a6bb4 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/fd469b7a-2056-4717-b7eb-52e722ddc96e HTTP/1.1" status: 204 len: 168 time: 0.2393110 Nov 11 11:42:37.279051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34158) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:37.479428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc41e60-f226-41ef-a0c7-83357d86c3ee req-04e608e9-d3dd-4bce-8e7a-2155daeae7b8 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:37.481145 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7dc41e60-f226-41ef-a0c7-83357d86c3ee req-04e608e9-d3dd-4bce-8e7a-2155daeae7b8 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0933006 Nov 11 11:42:37.528375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.574629 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7dc41e60-f226-41ef-a0c7-83357d86c3ee req-203a772d-20bb-489a-843e-8a370775d6f9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871582 Nov 11 11:42:37.585100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:37.590738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Usage tracker for resource:security_group_rule and tenant:99fba1ee257349a6b59f425699884fbe is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:37.595602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:37.602461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:37.622626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34172) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:37.648153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.707515 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:37.719175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Usage tracker for resource:security_group_rule and tenant:d04e67f4129e4e258a863d9cc7852ddc is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:37.724386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:37.733164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.734885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:37.791894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.801317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1c8226dd-1b3d-4a99-8014-c1a8979c38c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:37.831782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.857333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cd67de6-3fec-4a7e-914b-d751cf816091,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:37.860558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:37.862843 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=99fba1ee257349a6b59f425699884fbe&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5821640 Nov 11 11:42:37.865076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.865995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34180) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:37.872442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-903d453f-a21a-4bc2-8ecd-f515316bc765 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:37.916002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e2165bd-4939-48fd-baab-535c8eae394b,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:37.919073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:37.921600 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d04e67f4129e4e258a863d9cc7852ddc&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2978854 Nov 11 11:42:37.925735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34186) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:37.934448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8359a032-5f46-4255-b9ca-0a64f0e24a3f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.963695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8359a032-5f46-4255-b9ca-0a64f0e24a3f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:37.992660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d70c5294-3233-43da-95d2-06abccacc459 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:38.022641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d70c5294-3233-43da-95d2-06abccacc459 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:38.048504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8359a032-5f46-4255-b9ca-0a64f0e24a3f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:38.053791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-896913a0-5134-41f2-9c99-07ce094524e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:38.067557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8359a032-5f46-4255-b9ca-0a64f0e24a3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cd67de6-3fec-4a7e-914b-d751cf816091,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:38.071283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8359a032-5f46-4255-b9ca-0a64f0e24a3f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:38.076874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8359a032-5f46-4255-b9ca-0a64f0e24a3f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:38.078845 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8359a032-5f46-4255-b9ca-0a64f0e24a3f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0cd67de6-3fec-4a7e-914b-d751cf816091 HTTP/1.1" status: 204 len: 168 time: 0.2109196 Nov 11 11:42:38.097797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d70c5294-3233-43da-95d2-06abccacc459 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:38.107189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e44d3f5a-9881-45af-8bbe-0bf670cd47a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:38.132909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d70c5294-3233-43da-95d2-06abccacc459 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e2165bd-4939-48fd-baab-535c8eae394b,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:38.136485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d70c5294-3233-43da-95d2-06abccacc459 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:38.159614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d70c5294-3233-43da-95d2-06abccacc459 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:38.161208 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d70c5294-3233-43da-95d2-06abccacc459 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1e2165bd-4939-48fd-baab-535c8eae394b HTTP/1.1" status: 204 len: 168 time: 0.2341263 Nov 11 11:42:39.991778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d4dafb1-e3ef-4e52-9220-08d1d3d0d46a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:41.285417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:42.027470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34354) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:42.192561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:42.226152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:42.230456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Usage tracker for resource:security_group_rule and tenant:78a349af9a3142179cb68500341861e6 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:42.234131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:42.240262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:42.309085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:42.348303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:42.356002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6dfc41ca-4350-40d7-b3fa-a1b0f5028452 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:42.398540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e9c5bf2-784f-4868-97f9-9508599691f5,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:42.401687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:42.405112 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=78a349af9a3142179cb68500341861e6&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3759794 Nov 11 11:42:42.407921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34362) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:42.477412 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3a354688-ecde-413d-bd1b-c132b55a6fbc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:42.504705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3a354688-ecde-413d-bd1b-c132b55a6fbc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:42.619262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3a354688-ecde-413d-bd1b-c132b55a6fbc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:42.624536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0b398cce-71d4-4747-b5b3-adf07f3f2ff4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:42.638834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a354688-ecde-413d-bd1b-c132b55a6fbc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e9c5bf2-784f-4868-97f9-9508599691f5,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:42.642212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3a354688-ecde-413d-bd1b-c132b55a6fbc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:42.644330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3a354688-ecde-413d-bd1b-c132b55a6fbc admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:42.658976 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3a354688-ecde-413d-bd1b-c132b55a6fbc admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/6e9c5bf2-784f-4868-97f9-9508599691f5 HTTP/1.1" status: 204 len: 168 time: 0.2400904 Nov 11 11:42:42.769524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5564abe-ad69-4cc2-a45c-f62de4c23271 req-e61377ef-8fd2-4d95-a3d1-29fdfd60d62f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:42.771226 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c5564abe-ad69-4cc2-a45c-f62de4c23271 req-e61377ef-8fd2-4d95-a3d1-29fdfd60d62f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1092527 Nov 11 11:42:42.825126 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c5564abe-ad69-4cc2-a45c-f62de4c23271 req-5221418a-0b05-4eb8-97fd-c7b7208efd25 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470247 Nov 11 11:42:43.195095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34392) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:43.218100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.250106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:43.254131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Usage tracker for resource:security_group_rule and tenant:b0de4c069e2e49a988dabf7009079eba is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:43.257073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:43.263003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:43.329064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.350306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.358232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-45af2619-fa94-4a1c-bed4-2b6a903a6bb4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:43.399437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07b5f7c0-3b14-40c4-aca4-6570b13c4620,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:43.402963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:43.405911 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b0de4c069e2e49a988dabf7009079eba&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2097056 Nov 11 11:42:43.416175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34396) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:43.462594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-74bdf5ac-92c0-4276-aeaa-765ae2b8f1e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.484397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a2dd34a1-2d1e-4b6d-9c13-c344b8e87896 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.499776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.511704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a2dd34a1-2d1e-4b6d-9c13-c344b8e87896 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.625554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a2dd34a1-2d1e-4b6d-9c13-c344b8e87896 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.630856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d70c5294-3233-43da-95d2-06abccacc459 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:43.648152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dd34a1-2d1e-4b6d-9c13-c344b8e87896 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07b5f7c0-3b14-40c4-aca4-6570b13c4620,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:43.650937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a2dd34a1-2d1e-4b6d-9c13-c344b8e87896 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:43.652147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a2dd34a1-2d1e-4b6d-9c13-c344b8e87896 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:43.656223 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a2dd34a1-2d1e-4b6d-9c13-c344b8e87896 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/07b5f7c0-3b14-40c4-aca4-6570b13c4620 HTTP/1.1" status: 204 len: 168 time: 0.2361455 Nov 11 11:42:44.057535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6cf3919-de26-4d6c-9a44-ea31e137f6dc req-8f39df61-556c-4c2d-947c-03306956022a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:44.059130 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c6cf3919-de26-4d6c-9a44-ea31e137f6dc req-8f39df61-556c-4c2d-947c-03306956022a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0953968 Nov 11 11:42:44.112331 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c6cf3919-de26-4d6c-9a44-ea31e137f6dc req-1f3bdd21-d951-492e-ae2d-f4397f7f29b7 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464602 Nov 11 11:42:44.611181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:45.342259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea6f600-2449-4c66-a119-48e81b7d3925 req-7792cd4b-7db9-4cab-9780-94e1c00e8e5e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:45.343920 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9ea6f600-2449-4c66-a119-48e81b7d3925 req-7792cd4b-7db9-4cab-9780-94e1c00e8e5e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0907948 Nov 11 11:42:45.589098 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9ea6f600-2449-4c66-a119-48e81b7d3925 req-02ce0b65-888a-4efd-a994-683b67979b1f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2380948 Nov 11 11:42:46.807614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e7e451-506a-41c4-9323-e44c4b4546ee req-be203ec7-246b-4172-a7bb-20d06c2d487c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:46.809147 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-90e7e451-506a-41c4-9323-e44c4b4546ee req-be203ec7-246b-4172-a7bb-20d06c2d487c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0879648 Nov 11 11:42:46.872272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34538) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:46.874635 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-90e7e451-506a-41c4-9323-e44c4b4546ee req-06d55edb-e5c5-48c5-81c5-113abdf33e9c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577412 Nov 11 11:42:47.068298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.103668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:47.108613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Usage tracker for resource:security_group_rule and tenant:3d235f625f9e4ed3a2f261b852553da0 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:47.112107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:47.118648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:47.226723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.265243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.278559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05200e64-0899-4a7f-b149-cb23c3556759 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:47.325823 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3d235f625f9e4ed3a2f261b852553da0&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4520876 Nov 11 11:42:47.326591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3a135c6-65ff-4737-9613-9acc2965138d,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:47.329624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34556) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:47.330422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:47.363714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34560) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:47.406216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d5916242-f439-40f9-baa0-be434f03c15e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.434865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d5916242-f439-40f9-baa0-be434f03c15e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.530548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d5916242-f439-40f9-baa0-be434f03c15e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.533941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.539840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5d8044fd-3ef0-4d31-b14c-43777ea1fb18 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:47.563296 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5916242-f439-40f9-baa0-be434f03c15e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3a135c6-65ff-4737-9613-9acc2965138d,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:47.571425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d5916242-f439-40f9-baa0-be434f03c15e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:47.573952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d5916242-f439-40f9-baa0-be434f03c15e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.577544 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d5916242-f439-40f9-baa0-be434f03c15e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c3a135c6-65ff-4737-9613-9acc2965138d HTTP/1.1" status: 204 len: 168 time: 0.2416027 Nov 11 11:42:47.581753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:47.587164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Usage tracker for resource:security_group_rule and tenant:e526211a5de24f73b142eebbcb4d6c19 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:47.591232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:47.606931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:47.694265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.737136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.745834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b87ee36a-b494-47f3-aaae-a96203367d98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:47.794531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d31928e-eda6-4ef2-9289-7a78af0d1f7a,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:47.801307 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=e526211a5de24f73b142eebbcb4d6c19&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4349725 Nov 11 11:42:47.801307 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:47.802844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34570) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:47.896122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d70e4da3-5809-4352-8b50-b41696e3c379 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:47.934116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d70e4da3-5809-4352-8b50-b41696e3c379 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:48.098888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d70e4da3-5809-4352-8b50-b41696e3c379 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:48.115960 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dcc53b1c-d90a-400c-8649-07fd0979ec11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:48.143467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d70e4da3-5809-4352-8b50-b41696e3c379 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d31928e-eda6-4ef2-9289-7a78af0d1f7a,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:48.150080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d70e4da3-5809-4352-8b50-b41696e3c379 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:48.163783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d70e4da3-5809-4352-8b50-b41696e3c379 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:48.165952 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d70e4da3-5809-4352-8b50-b41696e3c379 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/3d31928e-eda6-4ef2-9289-7a78af0d1f7a HTTP/1.1" status: 204 len: 168 time: 0.3615448 Nov 11 11:42:48.239858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b4955c-43f1-4172-8548-9c07b2ac4c26 req-0a329979-aa0e-4098-ab4d-5f16a818a50a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:48.242594 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-17b4955c-43f1-4172-8548-9c07b2ac4c26 req-0a329979-aa0e-4098-ab4d-5f16a818a50a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1462955 Nov 11 11:42:48.309796 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-17b4955c-43f1-4172-8548-9c07b2ac4c26 req-e56213ed-8868-4dec-b34a-a04c62745091 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516918 Nov 11 11:42:48.930200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34604) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:49.084659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1826005561-network', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:42:49.091338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:49.095484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Usage tracker for resource:network and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:49.098721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:49.104980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:49.157199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Made reservation on behalf of 1bcfb2b970f34aa9af017e16d6e4c699 for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:42:49.164266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:49.182786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:49.226878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:49.231682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Usage tracker for resource:security_group_rule and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:49.235189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:49.241946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:49.320653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:49.371430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:49.378239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8552cadc-85d2-4d07-b887-377126306e90 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:49.416625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1015} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:42:49.426020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9462277c-1dc6-4630-933d-d7771a212a6a,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:49.430105 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:49.434998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:49.435359 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Added segment dd4c3e53-e470-48d8-b1d2-0460f04c87ff of type vlan for network d5ec5e34-ac26-4927-b077-b0742eacb0fd Nov 11 11:42:49.471604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:49.557004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7139bd-6984-4329-83af-4a9e3384b019 req-9d00c387-8210-4fe9-a2c5-93b2eb4b2a60 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:49.558797 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ee7139bd-6984-4329-83af-4a9e3384b019 req-9d00c387-8210-4fe9-a2c5-93b2eb4b2a60 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0896046 Nov 11 11:42:49.565408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:49.566742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:49.567421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:49.571954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:49.620282 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ee7139bd-6984-4329-83af-4a9e3384b019 req-3a0cc2dd-525a-4a6a-b5cd-62accd5ad12b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493968 Nov 11 11:42:49.690609 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Pushing event updated for resources: {'Network': ['ID=d5ec5e34-ac26-4927-b077-b0742eacb0fd,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:49.693453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:49.701705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:42:49.752296 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.8205881 Nov 11 11:42:49.755351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34624) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:49.762048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Request body: {'subnet': {'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1826005561-subnet', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:42:49.768325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:49.772781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Usage tracker for resource:subnet and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:49.776111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:49.782955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:49.830904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Made reservation on behalf of 1bcfb2b970f34aa9af017e16d6e4c699 for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:42:49.835315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036852136936'] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.085274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created--9223372036852097580', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036852136951'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.090765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-17437cdf-67e0-4fc5-a397-c09da82a85c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:50.164427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Pushing event updated for resources: {'Subnet': ['ID=6e9509c6-37ce-4e40-8036-e5d45e65095d,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:50.169534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:50.181701 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Checking segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:42:50.182094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Network hostable DHCP agents. Network: d5ec5e34-ac26-4927-b077-b0742eacb0fd, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:42:50.227659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:42:50.264698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, d5ec5e34-ac26-4927-b077-b0742eacb0fd) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:42:50.269101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:50.269832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.278242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-381a6522-7cfe-45e7-95d9-f632f995bbe0 None None] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:42:50.337697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34632) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:50.338467 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5818453 Nov 11 11:42:50.344374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:42:50.349502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:50.353579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Usage tracker for resource:router and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:50.356709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:50.363913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:50.402212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.403497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.427624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.574953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-d5ec5e34-ac26-4927-b077-b0742eacb0fd', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:42:50.575900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.679778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.759320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Allocated IP 172.20.0.2 (d5ec5e34-ac26-4927-b077-b0742eacb0fd/6e9509c6-37ce-4e40-8036-e5d45e65095d/1f35d8de-3bb7-492a-ad28-3aa45d51adb1) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:42:50.944913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ae756a-4c59-4a11-89f0-82d4961a0ee6 req-99cfa509-c61d-410d-a87c-2fb9b017cc2c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:50.946648 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-84ae756a-4c59-4a11-89f0-82d4961a0ee6 req-99cfa509-c61d-410d-a87c-2fb9b017cc2c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1178303 Nov 11 11:42:50.986945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:50.998881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Transition to ACTIVE for port object 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:42:51.018963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Transition to ACTIVE for port object 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:42:51.049965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.076813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.082538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f2a-53b1-4772-bc21-cf18834e64f3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:51.090030 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.094215 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-84ae756a-4c59-4a11-89f0-82d4961a0ee6 req-7d420fef-6899-4cba-8873-03f47e36ce14 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1124892 Nov 11 11:42:51.150930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:42:51.152235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:42:51.161716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:42:51.173544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Pushing event updated for resources: {'Port': ['ID=1f35d8de-3bb7-492a-ad28-3aa45d51adb1,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:51.184105 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.184575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.184867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.185253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.186242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.186625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.187003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.187410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.187788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.188157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.188526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:51.217498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:51.280152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Attempting to bind port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:42:51.280565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Attempting to bind port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:42:51.280975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Attempting to bind port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 on network d5ec5e34-ac26-4927-b077-b0742eacb0fd {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:42:51.288457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:42:51.288995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Checking segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:42:51.289503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.289666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Allocated IP 172.27.3.225 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/75c7dfeb-1d5b-460b-be21-2836e4686888) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:42:51.289948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Bound using segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:42:51.290490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Bound port: 1f35d8de-3bb7-492a-ad28-3aa45d51adb1, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:42:51.291163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.390780 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] For port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:42:51.395076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] For port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=1f35d8de-3bb7-492a-ad28-3aa45d51adb1,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:42:51.434691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.446476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:51.459491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.522259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.537378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-21fe1a4a-6bf5-4ef9-886c-425adecb2fc3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:51.553901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Pushing event updated for resources: {'Port': ['ID=1f35d8de-3bb7-492a-ad28-3aa45d51adb1,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:51.560005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:51.594965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:42:51.596343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:42:51.605099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:42:51.679812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Pushing event updated for resources: {'Port': ['ID=75c7dfeb-1d5b-460b-be21-2836e4686888,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:51.684835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:51.922006 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:51.922786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:52.231174 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Router e7a84a32-cf44-4d0e-908d-7569d000b45d is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88329) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:42:52.455356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:42:52.474030 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:42:52.483885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:42:52.497139 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:42:52.498150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:42:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:42:52.519488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Notify callbacks [] for router, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:52.523892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34654) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:52.524280 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.1852996 Nov 11 11:42:52.654083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:42:52.733523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:42:53.088170 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:51Z', 'revision_number': 3, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:42:53.093204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:42:53.093594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Updating router e7a84a32-cf44-4d0e-908d-7569d000b45d port 75c7dfeb-1d5b-460b-be21-2836e4686888 binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:42:53.155371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.378675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e981b0ca-fc8c-4881-838d-a9299bb66f58 None None] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:42:53.547478 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] Provisioning for port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:42:53.555506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] Provisioning complete for port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:42:53.556358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.582285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.598343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Transition to ACTIVE for port object 75c7dfeb-1d5b-460b-be21-2836e4686888 will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:42:53.637011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.653581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.665214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:53.807918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.826841 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Attempting to bind port 75c7dfeb-1d5b-460b-be21-2836e4686888 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:42:53.832485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Attempting to bind port 75c7dfeb-1d5b-460b-be21-2836e4686888 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:42:53.833199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Attempting to bind port 75c7dfeb-1d5b-460b-be21-2836e4686888 on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:42:53.859035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Pushing event updated for resources: {'Port': ['ID=75c7dfeb-1d5b-460b-be21-2836e4686888,revision_number=2']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:53.868328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:42:53.868328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:42:53.868328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.868328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:42:53.868328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Bound port: 75c7dfeb-1d5b-460b-be21-2836e4686888, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:42:53.868328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.883077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] For port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=1f35d8de-3bb7-492a-ad28-3aa45d51adb1,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:42:53.907632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.908020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.908401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.908772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.909148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.909519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.909888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.910275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.910644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.911009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.911405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:42:53.921389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:53.924949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:53.928135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:53.988425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] For port 75c7dfeb-1d5b-460b-be21-2836e4686888, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:42:53.992061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] For port 75c7dfeb-1d5b-460b-be21-2836e4686888, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=75c7dfeb-1d5b-460b-be21-2836e4686888,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:42:54.027499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:54.030719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Allocated IP 172.20.0.1 (d5ec5e34-ac26-4927-b077-b0742eacb0fd/6e9509c6-37ce-4e40-8036-e5d45e65095d/591fa385-fa3e-401b-9805-c6a8d6414fa3) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:42:54.036118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c1eab91-b674-48fb-9e67-6ff188552cf5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:54.058159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] Pushing event updated for resources: {'Port': ['ID=1f35d8de-3bb7-492a-ad28-3aa45d51adb1,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:54.062140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:54.161003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Pushing event updated for resources: {'Port': ['ID=75c7dfeb-1d5b-460b-be21-2836e4686888,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:54.166216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:54.169551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:42:54.171713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:42:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:42:54.254484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-544396f0-02ba-4e31-a6f6-1ea0af3e449a None None] Provisioning complete for port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:42:54.255416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-544396f0-02ba-4e31-a6f6-1ea0af3e449a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:54.298693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:54.334010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Transition to ACTIVE for port object 591fa385-fa3e-401b-9805-c6a8d6414fa3 will not be triggered until provisioned by entity DHCP. {{(pid=88328) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:42:54.394482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:54.405342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:54.442709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:42:54.484867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:42:54.488276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:42:54.504833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:42:54.563777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:42:54.564207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:54.575784 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Pushing event updated for resources: {'Port': ['ID=591fa385-fa3e-401b-9805-c6a8d6414fa3,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:54.591686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:54.628346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:54.672579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:42:54.830161 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:54.979224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-05bb6b2f-a5e8-4ac3-a7f6-c77be0519270 None None] Provisioning for port 591fa385-fa3e-401b-9805-c6a8d6414fa3 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:42:54.988765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-05bb6b2f-a5e8-4ac3-a7f6-c77be0519270 None None] Provisioning complete for port 591fa385-fa3e-401b-9805-c6a8d6414fa3 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:42:54.989751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-05bb6b2f-a5e8-4ac3-a7f6-c77be0519270 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:55.079673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:51Z', 'revision_number': 3, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:42:55.084546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5078dc78-8870-49f8-817a-24e9109857e9 None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:51Z', 'revision_number': 3, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:42:55.096149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-05bb6b2f-a5e8-4ac3-a7f6-c77be0519270 None None] Port 591fa385-fa3e-401b-9805-c6a8d6414fa3 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:42:55.202856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:55.274959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-895939bb-7d65-47b4-8e46-d37b4c60845c req-596bb0e8-1b84-40ec-9e2d-8fc75400e0de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:55.274959 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-895939bb-7d65-47b4-8e46-d37b4c60845c req-596bb0e8-1b84-40ec-9e2d-8fc75400e0de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1050544 Nov 11 11:42:55.324927 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-895939bb-7d65-47b4-8e46-d37b4c60845c req-d9b2c61b-401a-4546-b38f-4223ad901115 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455561 Nov 11 11:42:55.339848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:55.376517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:55.465192 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Pushing event updated for resources: {'Port': ['ID=591fa385-fa3e-401b-9805-c6a8d6414fa3,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:55.468337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:55.469573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:55.658446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:42:55.660642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:42:56.029305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-f70f600a-49fc-4f99-b9d5-ea36b2a7b24c None None] Provisioning complete for port 591fa385-fa3e-401b-9805-c6a8d6414fa3 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:42:56.029743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f70f600a-49fc-4f99-b9d5-ea36b2a7b24c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:56.109363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f70f600a-49fc-4f99-b9d5-ea36b2a7b24c None None] Port 591fa385-fa3e-401b-9805-c6a8d6414fa3 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:42:56.130292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Router e7a84a32-cf44-4d0e-908d-7569d000b45d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:42:56.378415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:42:56.389322 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] 10.222.0.11 "PUT /v2.0/routers/e7a84a32-cf44-4d0e-908d-7569d000b45d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8632302 Nov 11 11:42:56.462022 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 75c7dfeb-1d5b-460b-be21-2836e4686888 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:42:56.588030 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 75c7dfeb-1d5b-460b-be21-2836e4686888 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:42:56.595746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 75c7dfeb-1d5b-460b-be21-2836e4686888 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:42:56.596268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:56.727456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:56.747918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 75c7dfeb-1d5b-460b-be21-2836e4686888, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=75c7dfeb-1d5b-460b-be21-2836e4686888,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:42:56.776951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:56.779623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:56.851983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=75c7dfeb-1d5b-460b-be21-2836e4686888,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:56.855382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:57.461949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34708) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:57.468275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-404019582-network', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:42:57.473481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:57.477675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Usage tracker for resource:network and tenant:cfdc6b30588547c7b66704fb3a697c2e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:57.480738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:57.486803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:57.539001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Made reservation on behalf of cfdc6b30588547c7b66704fb3a697c2e for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:42:57.544041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:57.558735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:57.593808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:57.598206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Usage tracker for resource:security_group_rule and tenant:cfdc6b30588547c7b66704fb3a697c2e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:57.601714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:57.609755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:57.680820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:57.715987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:57.720717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b34d91f1-d81a-4498-9eb9-2c4e43f076ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:57.752828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1009} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:42:57.762373 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a8f9d2c-13be-4ad1-9ea7-1523bbb1e810,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:57.765892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:57.796078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:57.796473 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Added segment 78ed9e2e-e20d-42d4-a7f4-c2e4bec06612 of type vlan for network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 Nov 11 11:42:57.880470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:58.002182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:58.003566 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:58.004236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:58.009837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:58.125361 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Pushing event updated for resources: {'Network': ['ID=71ce433b-c614-4f0f-bf3e-b123f1ebde67,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:58.128269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:58.140522 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:42:58.147969 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6818001 Nov 11 11:42:58.148530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34714) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:58.156369 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Request body: {'subnet': {'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-404019582-subnet', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:42:58.162176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:58.167305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Usage tracker for resource:subnet and tenant:cfdc6b30588547c7b66704fb3a697c2e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:58.171137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:58.178008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:58.219141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Made reservation on behalf of cfdc6b30588547c7b66704fb3a697c2e for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:42:58.224832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036852136936'] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:58.344673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:42:58.359270 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:42:58.359964 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:42:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:42:58.446410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 75c7dfeb-1d5b-460b-be21-2836e4686888 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:42:58.568719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created--9223372036852097580', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036852136951'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:58.574130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:42:58.656047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f9a4a053-ae53-47ec-a7c1-8726ce54ecda,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:42:58.662691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:42:58.680301 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Checking segment: {'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:42:58.680711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Network hostable DHCP agents. Network: 71ce433b-c614-4f0f-bf3e-b123f1ebde67, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:42:58.739922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:42:58.780453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 71ce433b-c614-4f0f-bf3e-b123f1ebde67) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:42:58.786462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:58.787531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:58.800571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32fce5cc-2b06-4606-b995-a805b9e90681 None None] Network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:42:58.871181 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7208266 Nov 11 11:42:58.874776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34722) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:42:58.880933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:42:58.886857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:42:58.891647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Usage tracker for resource:router and tenant:cfdc6b30588547c7b66704fb3a697c2e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:42:58.894990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:42:58.902697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:42:58.904573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:42:58.950802 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:58.952095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:58.961041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 75c7dfeb-1d5b-460b-be21-2836e4686888 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:42:58.961445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:59.057535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:59.448244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-71ce433b-c614-4f0f-bf3e-b123f1ebde67', 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'fixed_ips': [{'subnet_id': 'f9a4a053-ae53-47ec-a7c1-8726ce54ecda'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:42:59.449180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:59.634324 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:59.731383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-735ee6dc-452f-4bd9-b8eb-e47ad393e8d8 req-1caa4834-d915-4021-8ee4-9f6ea986df45 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:42:59.735852 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-735ee6dc-452f-4bd9-b8eb-e47ad393e8d8 req-1caa4834-d915-4021-8ee4-9f6ea986df45 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1151061 Nov 11 11:42:59.760835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 2, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:42:59.802786 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-735ee6dc-452f-4bd9-b8eb-e47ad393e8d8 req-37d042b3-fcfe-4ec3-8aee-d3ddc67ebf6d tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625901 Nov 11 11:42:59.820982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:42:59.821304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Updating router e7a84a32-cf44-4d0e-908d-7569d000b45d port 591fa385-fa3e-401b-9805-c6a8d6414fa3 binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:42:59.903890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:59.923946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Allocated IP 172.20.0.2 (71ce433b-c614-4f0f-bf3e-b123f1ebde67/f9a4a053-ae53-47ec-a7c1-8726ce54ecda/f50ea43a-b1f2-404e-a833-c8c1b9094abe) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:42:59.959277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:42:59.994004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:00.210788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Allocated IP 172.27.3.59 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/89241b8c-96f0-4409-873c-7c7a4b4ec63b) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:43:00.397846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:00.411611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:00.438241 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Transition to ACTIVE for port object f50ea43a-b1f2-404e-a833-c8c1b9094abe will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:43:00.480750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:00.497020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-854d5c2c-8b26-49d1-8fc9-34abc2b0a2dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:00.508975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Transition to ACTIVE for port object f50ea43a-b1f2-404e-a833-c8c1b9094abe will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:43:00.543880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:00.557519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Transition to ACTIVE for port object 591fa385-fa3e-401b-9805-c6a8d6414fa3 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:43:00.585156 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:00.590852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:00.601097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:43:00.605613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:43:00.608325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Pushing event updated for resources: {'Port': ['ID=89241b8c-96f0-4409-873c-7c7a4b4ec63b,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:00.612624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:43:00.644826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:00.657474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:00.733322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:43:00.742920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:43:00.756200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Pushing event updated for resources: {'Port': ['ID=f50ea43a-b1f2-404e-a833-c8c1b9094abe,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:00.759460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:43:00.762070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:00.762847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.107s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:00.902591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:00.903429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:01.137761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f959929-81de-493d-9ff2-9a70ea29df32 req-7e9ff842-3d04-4f5c-aeab-cc050203c577 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:01.141450 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4f959929-81de-493d-9ff2-9a70ea29df32 req-7e9ff842-3d04-4f5c-aeab-cc050203c577 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1335461 Nov 11 11:43:01.197163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05bbb619-5ffb-4ef5-bf44-a46b4d942e6c None None] Pushing event updated for resources: {'Port': ['ID=591fa385-fa3e-401b-9805-c6a8d6414fa3,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:01.212988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05bbb619-5ffb-4ef5-bf44-a46b4d942e6c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.450s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:01.231379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Attempting to bind port f50ea43a-b1f2-404e-a833-c8c1b9094abe on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:43:01.232511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Attempting to bind port f50ea43a-b1f2-404e-a833-c8c1b9094abe by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:43:01.233265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Attempting to bind port f50ea43a-b1f2-404e-a833-c8c1b9094abe on network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:43:01.244798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Attempting to bind port 591fa385-fa3e-401b-9805-c6a8d6414fa3 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:43:01.245332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Attempting to bind port 591fa385-fa3e-401b-9805-c6a8d6414fa3 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:43:01.245819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Attempting to bind port 591fa385-fa3e-401b-9805-c6a8d6414fa3 on network d5ec5e34-ac26-4927-b077-b0742eacb0fd {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:43:01.248329 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4f959929-81de-493d-9ff2-9a70ea29df32 req-51ad8265-7735-41a5-a60f-b8c3156ed801 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896587 Nov 11 11:43:01.252834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:43:01.253488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Checking segment: {'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:43:01.254027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:01.254554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Bound using segment: {'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:43:01.255486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Bound port: f50ea43a-b1f2-404e-a833-c8c1b9094abe, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:43:01.255883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:01.291326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Router a03778cc-5501-4f10-ad17-ba4d2c2980e0 is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88328) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:43:01.319499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:43:01.319969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Checking segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:43:01.320627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:01.321216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Bound using segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:43:01.321877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Bound port: 591fa385-fa3e-401b-9805-c6a8d6414fa3, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:43:01.322368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:01.445137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] For port f50ea43a-b1f2-404e-a833-c8c1b9094abe, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:43:01.472309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] For port f50ea43a-b1f2-404e-a833-c8c1b9094abe, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f50ea43a-b1f2-404e-a833-c8c1b9094abe,segment=NetworkSegment(78ed9e2e-e20d-42d4-a7f4-c2e4bec06612),segment_id=78ed9e2e-e20d-42d4-a7f4-c2e4bec06612)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:43:01.515950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:01.525256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:01.539424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:43:01.558171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Sync routers for ids ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:43:01.581932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Routers {'a03778cc-5501-4f10-ad17-ba4d2c2980e0'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:43:01.583332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:42:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:01.594974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] For port 591fa385-fa3e-401b-9805-c6a8d6414fa3, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:43:01.620385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] For port 591fa385-fa3e-401b-9805-c6a8d6414fa3, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=591fa385-fa3e-401b-9805-c6a8d6414fa3,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:43:01.622470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:01.627163 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.7484937 Nov 11 11:43:01.628318 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34750) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:01.658942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:01.710668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Pushing event updated for resources: {'Port': ['ID=f50ea43a-b1f2-404e-a833-c8c1b9094abe,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:01.723337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:01.724128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.061s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:01.855933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:43:01.856653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:42:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:01.940789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Set router a03778cc-5501-4f10-ad17-ba4d2c2980e0 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:43:02.020452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05bbb619-5ffb-4ef5-bf44-a46b4d942e6c None None] Pushing event updated for resources: {'Port': ['ID=591fa385-fa3e-401b-9805-c6a8d6414fa3,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:02.088819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05bbb619-5ffb-4ef5-bf44-a46b4d942e6c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.365s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:02.160568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:43:02.437946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:43:00Z', 'revision_number': 3, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:02.446240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Checking router: a03778cc-5501-4f10-ad17-ba4d2c2980e0 for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:43:02.446809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Updating router a03778cc-5501-4f10-ad17-ba4d2c2980e0 port 89241b8c-96f0-4409-873c-7c7a4b4ec63b binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:43:02.540362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:02.672988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f50ea43a-b1f2-404e-a833-c8c1b9094abe up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:43:02.722698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96a22ae-a4e1-4629-9029-8bbdfbf0f41a req-d90f1541-45ea-4d83-8d38-626d6b6874de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:02.737415 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c96a22ae-a4e1-4629-9029-8bbdfbf0f41a req-d90f1541-45ea-4d83-8d38-626d6b6874de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1835582 Nov 11 11:43:02.827508 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c96a22ae-a4e1-4629-9029-8bbdfbf0f41a req-e81a2905-501e-44b0-9739-1f9b6541d95b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890818 Nov 11 11:43:02.852818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:01Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:02.860935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbc529a5-9e1e-47be-9858-780fe5803a32 None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:01Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:43:02.864666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port f50ea43a-b1f2-404e-a833-c8c1b9094abe completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:43:03.512661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:03.514027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:03.514947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Transition to ACTIVE for port object 89241b8c-96f0-4409-873c-7c7a4b4ec63b will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:43:03.515499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Allocated IP 172.20.0.1 (71ce433b-c614-4f0f-bf3e-b123f1ebde67/f9a4a053-ae53-47ec-a7c1-8726ce54ecda/d0e644f1-77cf-4429-9b1e-d1642cbdfa7d) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:43:03.515888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:03.515888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:03.615852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Attempting to bind port 89241b8c-96f0-4409-873c-7c7a4b4ec63b on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:43:03.616269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Attempting to bind port 89241b8c-96f0-4409-873c-7c7a4b4ec63b by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:43:03.616683 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Attempting to bind port 89241b8c-96f0-4409-873c-7c7a4b4ec63b on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:43:03.624136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f80f40-b56d-4d62-bc27-a9acff71d34f None None] Pushing event updated for resources: {'Port': ['ID=89241b8c-96f0-4409-873c-7c7a4b4ec63b,revision_number=2']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:03.629368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-52f80f40-b56d-4d62-bc27-a9acff71d34f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:03.630607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:43:03.631025 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:43:03.631210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:03.631500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:03.631937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:43:03.632462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Bound port: 89241b8c-96f0-4409-873c-7c7a4b4ec63b, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:43:03.632884 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:03.654863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Transition to ACTIVE for port object d0e644f1-77cf-4429-9b1e-d1642cbdfa7d will not be triggered until provisioned by entity DHCP. {{(pid=88328) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:43:03.705187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:03.710484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:03.728520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] For port 89241b8c-96f0-4409-873c-7c7a4b4ec63b, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:43:03.732441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] For port 89241b8c-96f0-4409-873c-7c7a4b4ec63b, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=89241b8c-96f0-4409-873c-7c7a4b4ec63b,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:43:03.765667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:03.771334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:03.778020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:43:03.781711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:43:03.791170 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:43:03.894882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Routers {'a03778cc-5501-4f10-ad17-ba4d2c2980e0'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:43:03.895643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:42:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:04.126202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-168e515e-53c3-419c-b5b4-8ae9db94ec30 None None] Network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:43:04.132810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:04.171027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Pushing event updated for resources: {'Port': ['ID=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:04.174937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.464s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:04.188229 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f80f40-b56d-4d62-bc27-a9acff71d34f None None] Pushing event updated for resources: {'Port': ['ID=89241b8c-96f0-4409-873c-7c7a4b4ec63b,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:04.213173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc308b1-527a-4450-a574-794a0b0342b1 req-9146bf62-96a0-4bb2-91b5-dac613d662ff tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:04.224005 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fbc308b1-527a-4450-a574-794a0b0342b1 req-9146bf62-96a0-4bb2-91b5-dac613d662ff tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1357851 Nov 11 11:43:04.230300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-52f80f40-b56d-4d62-bc27-a9acff71d34f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.459s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:04.258870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] Set router a03778cc-5501-4f10-ad17-ba4d2c2980e0 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:43:04.289213 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fbc308b1-527a-4450-a574-794a0b0342b1 req-a2746ace-6518-4184-84cf-740dba77cea1 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620604 Nov 11 11:43:04.309438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] Provisioning for port f50ea43a-b1f2-404e-a833-c8c1b9094abe completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:43:04.324812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] Provisioning complete for port f50ea43a-b1f2-404e-a833-c8c1b9094abe triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:04.325235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:04.381927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:04.583626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 591fa385-fa3e-401b-9805-c6a8d6414fa3 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:43:04.640593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:04.833402 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:04.893178 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:04.899438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:43:00Z', 'revision_number': 3, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:04.914755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 591fa385-fa3e-401b-9805-c6a8d6414fa3 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:43:04.921940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e63dfc4a-f193-41ad-adb4-6d2e01b038d1 None None] The sync data for ids ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'] in dv-cinder-817417-1-iscsi is: [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:43:00Z', 'revision_number': 3, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:43:04.931846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:04.946546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:04.973128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 591fa385-fa3e-401b-9805-c6a8d6414fa3 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:04.973128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:05.069593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:05.093418 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-85b5bcc4-f829-4f5d-9b48-960f488a32e9 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1098 time: 0.1635652 Nov 11 11:43:05.099798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Pushing event updated for resources: {'Port': ['ID=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:05.105143 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:05.125302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] For port f50ea43a-b1f2-404e-a833-c8c1b9094abe, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f50ea43a-b1f2-404e-a833-c8c1b9094abe,segment=NetworkSegment(78ed9e2e-e20d-42d4-a7f4-c2e4bec06612),segment_id=78ed9e2e-e20d-42d4-a7f4-c2e4bec06612)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:43:05.198562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:05.305472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:43:05.307009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:43:05.389932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-3ab36891-825f-4432-bb61-485862c38b8e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:05.398004 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-3ab36891-825f-4432-bb61-485862c38b8e service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.2679105 Nov 11 11:43:05.526594 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-932326e1-4ca8-40ef-8164-2495a1b07582 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 200 len: 217 time: 0.1148722 Nov 11 11:43:05.661064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:05.791710 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:05.936829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 591fa385-fa3e-401b-9805-c6a8d6414fa3, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=591fa385-fa3e-401b-9805-c6a8d6414fa3,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:43:05.976104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:05.986383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] Pushing event updated for resources: {'Port': ['ID=f50ea43a-b1f2-404e-a833-c8c1b9094abe,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:05.993291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:05.993825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.013s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:06.013565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-d7b96727-213f-4fb8-b32f-fd071427a0e3 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:06.015388 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-d7b96727-213f-4fb8-b32f-fd071427a0e3 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.4488466 Nov 11 11:43:06.047364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6c84bdf0-6870-4290-a742-4d9c61086f00 None None] Provisioning complete for port f50ea43a-b1f2-404e-a833-c8c1b9094abe triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:06.047953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c84bdf0-6870-4290-a742-4d9c61086f00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:06.090027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-7aadc84a-71ce-44ed-b14b-bf7f07b1f32e service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0641849 Nov 11 11:43:06.291096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=591fa385-fa3e-401b-9805-c6a8d6414fa3,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:06.333036 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Router a03778cc-5501-4f10-ad17-ba4d2c2980e0 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:43:06.352692 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-1b0f5a60-2b32-4057-8792-22a043d0029e service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2511449 Nov 11 11:43:06.359501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0060c4e-3544-4605-8148-1d56cf5285eb req-523b9830-d839-49a0-93d9-750e09b17073 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:06.368801 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f0060c4e-3544-4605-8148-1d56cf5285eb req-523b9830-d839-49a0-93d9-750e09b17073 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.8413310 Nov 11 11:43:06.494392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.500s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:06.573955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6c84bdf0-6870-4290-a742-4d9c61086f00 None None] Provisioning for port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:43:06.590427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6c84bdf0-6870-4290-a742-4d9c61086f00 None None] Provisioning complete for port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:06.590427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c84bdf0-6870-4290-a742-4d9c61086f00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:06.626070 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-646b32dc-b82e-47fa-a4fb-d8fd8c698f28 req-8aa6ed9a-3657-41f0-aec5-050194bd177d service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2555597 Nov 11 11:43:06.718453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-6c84bdf0-6870-4290-a742-4d9c61086f00 None None] Port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:43:06.764763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 89241b8c-96f0-4409-873c-7c7a4b4ec63b up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:43:06.766412 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f0060c4e-3544-4605-8148-1d56cf5285eb req-400b44c0-96db-4ff5-a83e-18535cc11382 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3976371 Nov 11 11:43:06.952879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:43:06.964798 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] 10.222.0.11 "PUT /v2.0/routers/a03778cc-5501-4f10-ad17-ba4d2c2980e0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3343966 Nov 11 11:43:06.995040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-43780b6c-3200-4fd7-8435-44e3f0831c3f None None] Provisioning complete for port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:06.995559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-43780b6c-3200-4fd7-8435-44e3f0831c3f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:07.130062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-43780b6c-3200-4fd7-8435-44e3f0831c3f None None] Port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:43:07.201791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 89241b8c-96f0-4409-873c-7c7a4b4ec63b completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:43:07.212790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 89241b8c-96f0-4409-873c-7c7a4b4ec63b triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:07.213603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:07.401317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:07.431334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 89241b8c-96f0-4409-873c-7c7a4b4ec63b, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=89241b8c-96f0-4409-873c-7c7a4b4ec63b,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:43:07.502467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:07.503919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f50ea43a-b1f2-404e-a833-c8c1b9094abe up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:43:07.580204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-52d5cd4a-f8b8-49a1-8f62-8086487cd632 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:07.722559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=89241b8c-96f0-4409-873c-7c7a4b4ec63b,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:07.727900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:07.756006 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port f50ea43a-b1f2-404e-a833-c8c1b9094abe triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:07.756714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.036257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 591fa385-fa3e-401b-9805-c6a8d6414fa3 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:43:08.130305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ddd02e-eaa4-46d0-9d67-b1d7bb93697f req-087f1c2a-1f6f-42b9-92cd-276c5c2c6aa6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:08.133518 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a3ddd02e-eaa4-46d0-9d67-b1d7bb93697f req-087f1c2a-1f6f-42b9-92cd-276c5c2c6aa6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1212485 Nov 11 11:43:08.186092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 591fa385-fa3e-401b-9805-c6a8d6414fa3 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:08.186686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.234329 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a3ddd02e-eaa4-46d0-9d67-b1d7bb93697f req-ac9db016-82b6-4a8a-b008-fbb74f34b45f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0923774 Nov 11 11:43:08.373508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34840) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:08.385438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2053754159', 'description': 'tempest-secgroup-smoke-2053754159 description', 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:08.392919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:08.397379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:security_group and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:08.400867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:08.408327 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:08.452379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.480651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 89241b8c-96f0-4409-873c-7c7a4b4ec63b up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:43:08.502497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:08.508223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:security_group_rule and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:08.513803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:08.525174 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:08.562216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:43:08.608195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.616840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 89241b8c-96f0-4409-873c-7c7a4b4ec63b triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:08.617272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.650621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.657246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cc72154f-c518-4fa1-93ba-0d49109bcc93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:08.701559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'SecurityGroup': ['ID=82ca2c36-3087-406f-9689-58bdf145dcc0,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:08.704648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:08.725946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.728387 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.3530684 Nov 11 11:43:08.731519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34844) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:08.739740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'security_group_rule': {'security_group_id': '82ca2c36-3087-406f-9689-58bdf145dcc0', 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:08.746370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:08.750904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:security_group_rule and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:08.754916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:08.761326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:08.819096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.895185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.927670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.930146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8134dd86-7090-4354-be1a-cfe0b95fbbc1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:08.955470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9470fd57-3316-4e81-a8b7-c433511c03f8,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:08.964308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:08.996433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:08.999723 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.2654064 Nov 11 11:43:09.002384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34850) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:09.009190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'security_group_rule': {'security_group_id': '82ca2c36-3087-406f-9689-58bdf145dcc0', 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:09.016984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:09.022207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:security_group_rule and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:09.025947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:09.033233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:09.080144 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.162157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.190174 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.192432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:09.211312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=381ab7a7-73d9-4dc7-bc97-40aebf67c215,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:09.219692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:09.265095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.266474 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.2628641 Nov 11 11:43:09.269525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34856) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:09.275795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'security_group_rule': {'security_group_id': '82ca2c36-3087-406f-9689-58bdf145dcc0', 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:09.282858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:09.287352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:security_group_rule and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:09.290754 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:09.299585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:09.365173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.447224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.475719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.478048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c74b86a1-aa04-4a9e-91f6-1d35e54029c9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:09.504820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f98b401b-5e42-4840-93ea-036a24a8791c,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:09.507561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:09.544815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-423a9763-4670-4d07-bf63-98b333dc524f req-e0123246-4a59-41ac-939f-8e086f1be8aa tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:09.547233 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-423a9763-4670-4d07-bf63-98b333dc524f req-e0123246-4a59-41ac-939f-8e086f1be8aa tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1182277 Nov 11 11:43:09.573719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.577543 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.3053057 Nov 11 11:43:09.579806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34866) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:09.587987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'security_group_rule': {'security_group_id': '82ca2c36-3087-406f-9689-58bdf145dcc0', 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:09.595132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:09.599794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:security_group_rule and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:09.603340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:09.621881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:09.646957 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-423a9763-4670-4d07-bf63-98b333dc524f req-5d477581-06b5-4bb1-8167-91fa1151459c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927737 Nov 11 11:43:09.695085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.848389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.933220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:09.935948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:09.961705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ef509e49-eab8-4432-94a3-c3df12f0d3a8,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:09.969164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:10.031256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.031564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-61ff271a-bdc4-4941-a931-eb71e2684774 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.034085 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.4533944 Nov 11 11:43:10.036474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 34874) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:10.047917 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'security_group_rule': {'security_group_id': '82ca2c36-3087-406f-9689-58bdf145dcc0', 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:10.058275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:10.065378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:security_group_rule and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:10.070379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:10.080674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:10.122761 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.securitygroups_db [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Project 1bcfb2b970f34aa9af017e16d6e4c699 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 11:43:10.134709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.245681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Sync routers for ids ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:43:10.249846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.259969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Routers {'a03778cc-5501-4f10-ad17-ba4d2c2980e0'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:43:10.260683 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:42:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:10.282308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.284604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7b7d643e-c851-4d45-8523-e82c1c6b2250 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:10.324235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=927bbab1-ee6c-4992-a643-569ccf220239,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:10.328073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:10.351314 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.352787 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bb62adb8-cf81-4190-81ba-9e24c91c5c3e req-fc23dfee-a770-40f4-8c34-a93fe3c21c7e service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1098 time: 0.0901656 Nov 11 11:43:10.355543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 34886) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:10.355682 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.3178990 Nov 11 11:43:10.362149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'security_group_rule': {'security_group_id': '82ca2c36-3087-406f-9689-58bdf145dcc0', 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:10.389283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:10.396462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:security_group_rule and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:10.407552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:10.417830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:10.429891 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bb62adb8-cf81-4190-81ba-9e24c91c5c3e req-83caccb2-6439-4380-9d5c-64afc89bdb46 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625184 Nov 11 11:43:10.459447 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.securitygroups_db [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Project 1bcfb2b970f34aa9af017e16d6e4c699 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 11:43:10.472227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.522031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Set router a03778cc-5501-4f10-ad17-ba4d2c2980e0 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:43:10.579570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.616491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.633064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:10.651279 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ac4d68d-6683-4ba6-9df1-526baa459bd8,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:10.654863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:10.693044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:10.697973 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1f7b20ce-f8bb-4389-a0de-406fd202e681 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.3378429 Nov 11 11:43:10.931776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212c8f0e-83bf-4c12-a3c6-fa107e927a32 req-f27836f9-7338-4a80-937c-bd064da34f6b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:10.933607 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-212c8f0e-83bf-4c12-a3c6-fa107e927a32 req-f27836f9-7338-4a80-937c-bd064da34f6b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1029217 Nov 11 11:43:11.010462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:43:04Z', 'revision_number': 4, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd0e644f1-77cf-4429-9b1e-d1642cbdfa7d', 'name': '', 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'mac_address': 'fa:16:3e:ef:63:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f9a4a053-ae53-47ec-a7c1-8726ce54ecda', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:03Z', 'updated_at': '2021-11-11T11:43:04Z', 'revision_number': 2, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'subnets': [{'id': 'f9a4a053-ae53-47ec-a7c1-8726ce54ecda', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:11.017585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Checking router: a03778cc-5501-4f10-ad17-ba4d2c2980e0 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:43:11.018032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Updating router a03778cc-5501-4f10-ad17-ba4d2c2980e0 port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:43:11.055225 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-212c8f0e-83bf-4c12-a3c6-fa107e927a32 req-202dd89b-a079-4095-b14f-e4415c910ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1124203 Nov 11 11:43:11.081433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:11.299229 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:11.602197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:11.617672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Transition to ACTIVE for port object d0e644f1-77cf-4429-9b1e-d1642cbdfa7d will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:43:11.663395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:11.671380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05bbb619-5ffb-4ef5-bf44-a46b4d942e6c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:12.027874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7508bb5a-52a8-4a40-9076-fa5171544aa8 None None] Pushing event updated for resources: {'Port': ['ID=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:12.034623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7508bb5a-52a8-4a40-9076-fa5171544aa8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.363s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:12.136921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Attempting to bind port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:43:12.137528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Attempting to bind port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:43:12.137846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Attempting to bind port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d on network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:43:12.145477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 43, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:43:12.145854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Checking segment: {'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:43:12.146264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:12.146715 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Bound using segment: {'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:43:12.147265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Bound port: d0e644f1-77cf-4429-9b1e-d1642cbdfa7d, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:43:12.147679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:12.265436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] For port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:43:12.269088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] For port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,segment=NetworkSegment(78ed9e2e-e20d-42d4-a7f4-c2e4bec06612),segment_id=78ed9e2e-e20d-42d4-a7f4-c2e4bec06612)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:43:12.320655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:12.325327 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d9c842-f520-4775-add8-52025af6b68c req-14ef85de-c159-449f-87df-87d419d5a09b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:12.326773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7060485c-e078-483e-bbca-e5a71a13a072 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:12.327194 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b2d9c842-f520-4775-add8-52025af6b68c req-14ef85de-c159-449f-87df-87d419d5a09b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1227615 Nov 11 11:43:12.383082 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b2d9c842-f520-4775-add8-52025af6b68c req-bf811bb3-e35b-417c-bfc3-8464b1252ed8 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492430 Nov 11 11:43:12.418002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7508bb5a-52a8-4a40-9076-fa5171544aa8 None None] Pushing event updated for resources: {'Port': ['ID=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:12.421838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Routers {'a03778cc-5501-4f10-ad17-ba4d2c2980e0'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:43:12.422534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:42:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:12.499380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7508bb5a-52a8-4a40-9076-fa5171544aa8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:12.724132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] Set router a03778cc-5501-4f10-ad17-ba4d2c2980e0 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:43:13.066029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d285c7-4cba-4ff4-af0c-d8ea9a99f11b req-9056db14-106e-4d02-9863-90568385ddfb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:13.068007 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-71d285c7-4cba-4ff4-af0c-d8ea9a99f11b req-9056db14-106e-4d02-9863-90568385ddfb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1079950 Nov 11 11:43:13.124765 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-71d285c7-4cba-4ff4-af0c-d8ea9a99f11b req-557ff4a5-89ad-4a34-ab8d-c0ddd7231630 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501764 Nov 11 11:43:13.161722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e985b907-816b-457b-aef1-03eed08870ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:43:04Z', 'revision_number': 4, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd0e644f1-77cf-4429-9b1e-d1642cbdfa7d', 'name': '', 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'mac_address': 'fa:16:3e:ef:63:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f9a4a053-ae53-47ec-a7c1-8726ce54ecda', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:03Z', 'updated_at': '2021-11-11T11:43:12Z', 'revision_number': 4, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'subnets': [{'id': 'f9a4a053-ae53-47ec-a7c1-8726ce54ecda', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:43:13.167468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e985b907-816b-457b-aef1-03eed08870ad None None] The sync data for ids ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'] in dv-cinder-817417-1-iscsi is: [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:43:04Z', 'revision_number': 4, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd0e644f1-77cf-4429-9b1e-d1642cbdfa7d', 'name': '', 'network_id': '71ce433b-c614-4f0f-bf3e-b123f1ebde67', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'mac_address': 'fa:16:3e:ef:63:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f9a4a053-ae53-47ec-a7c1-8726ce54ecda', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:03Z', 'updated_at': '2021-11-11T11:43:12Z', 'revision_number': 4, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'subnets': [{'id': 'f9a4a053-ae53-47ec-a7c1-8726ce54ecda', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:43:13.464613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-36d0eaaf-197c-4333-b104-95eabd9a0524 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:13.493172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:14.479258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device d0e644f1-77cf-4429-9b1e-d1642cbdfa7d up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:43:14.623953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:43:14.628446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:14.628765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:14.658129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:14.769561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:14.844310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,segment=NetworkSegment(78ed9e2e-e20d-42d4-a7f4-c2e4bec06612),segment_id=78ed9e2e-e20d-42d4-a7f4-c2e4bec06612)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:43:14.879936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:14.883417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:14.988742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:14.992551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:16.447943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device d0e644f1-77cf-4429-9b1e-d1642cbdfa7d up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:43:16.533594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:16.534026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:20.467217 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-bae6754d-3f38-45d3-8cbb-ff0c5616209e service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1098 time: 0.0930846 Nov 11 11:43:20.674080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda5767f-8659-4982-a4b1-d690c8e71e2a req-b24ed61f-a305-4c94-adac-b0125cf53ebb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:20.675705 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eda5767f-8659-4982-a4b1-d690c8e71e2a req-b24ed61f-a305-4c94-adac-b0125cf53ebb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.2050574 Nov 11 11:43:20.717278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-e25c5718-0233-48f8-83d3-7bda364fd181 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:20.717278 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-e25c5718-0233-48f8-83d3-7bda364fd181 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.2061234 Nov 11 11:43:20.806570 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-aeeea34b-9d17-43a7-9a2b-762fc0a828a7 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 200 len: 217 time: 0.0837381 Nov 11 11:43:20.814961 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eda5767f-8659-4982-a4b1-d690c8e71e2a req-8d564aa0-8203-49c0-868b-89d771a4d828 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1222551 Nov 11 11:43:20.889919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-dfec0c99-e0e3-463d-857a-2bad6c7b041c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:20.891524 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-dfec0c99-e0e3-463d-857a-2bad6c7b041c service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.0710516 Nov 11 11:43:20.949961 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-90a69c6e-af77-41b4-a8d6-4a3fbf8d8173 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0478292 Nov 11 11:43:21.112596 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-e836ae25-7fea-41f6-a930-fcd49f24d263 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1523314 Nov 11 11:43:21.271384 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3bfb37ea-4cf9-45e1-8bbe-07b1dff0b912 req-1cc53563-bf04-47eb-9efd-c8a82ef6d2d1 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1519763 Nov 11 11:43:22.046092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc7c64c-0f69-4f16-9f82-9fbc4d62c2b2 req-2381f3a1-ed33-4a1d-a249-6faecf092aab tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:22.048248 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6dc7c64c-0f69-4f16-9f82-9fbc4d62c2b2 req-2381f3a1-ed33-4a1d-a249-6faecf092aab tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0859542 Nov 11 11:43:22.107095 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6dc7c64c-0f69-4f16-9f82-9fbc4d62c2b2 req-1b9d0ecd-8d3d-47dd-829f-cf2c193c7dda tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520611 Nov 11 11:43:23.327962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65f60b3-c824-4cbb-a31f-2ed1bf40225b req-25e34a10-ee76-4c0e-a282-9444abfd5c0b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:23.329586 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b65f60b3-c824-4cbb-a31f-2ed1bf40225b req-25e34a10-ee76-4c0e-a282-9444abfd5c0b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0903935 Nov 11 11:43:23.383573 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b65f60b3-c824-4cbb-a31f-2ed1bf40225b req-86a9fecd-0807-47a6-a58e-3086b6f0395c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471091 Nov 11 11:43:24.607180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-851f9117-ffd8-4400-8ec7-16d96de1b972 req-3aef6b40-9c0f-4d66-bf21-2e40da28b351 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:24.611946 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-851f9117-ffd8-4400-8ec7-16d96de1b972 req-3aef6b40-9c0f-4d66-bf21-2e40da28b351 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0923166 Nov 11 11:43:24.670798 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-851f9117-ffd8-4400-8ec7-16d96de1b972 req-634b6eb0-2cb0-4a15-aef6-0b8fd188a7a9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508738 Nov 11 11:43:25.897129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9c6bc2-5001-46bb-b433-df9914ee1e8e req-db590d6c-bb15-4547-b968-272a1f566f2a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:25.898831 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2b9c6bc2-5001-46bb-b433-df9914ee1e8e req-db590d6c-bb15-4547-b968-272a1f566f2a tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0920069 Nov 11 11:43:25.961894 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2b9c6bc2-5001-46bb-b433-df9914ee1e8e req-f0c9c708-e28c-45a7-bba8-bba4ab2af5d4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520041 Nov 11 11:43:29.367591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5039c39b-342c-434b-8ac4-5a77cf262be9 req-4f8bd496-5595-49bc-8d58-eef04a43cd78 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:29.369263 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5039c39b-342c-434b-8ac4-5a77cf262be9 req-4f8bd496-5595-49bc-8d58-eef04a43cd78 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0948844 Nov 11 11:43:29.432506 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5039c39b-342c-434b-8ac4-5a77cf262be9 req-842af992-664a-4958-bd45-3e265837edbc tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500169 Nov 11 11:43:29.873356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 35194) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:30.068927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:30.125557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:30.130472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Usage tracker for resource:security_group_rule and tenant:7383161a9a0f4f6aa7fb56478b5c6a5f is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:30.134342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:30.142444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:30.233899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:30.282343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:30.292763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c1d8a37c-ecfb-4b71-84e3-46540374e93a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:30.346752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 35212) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:30.347311 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7383161a9a0f4f6aa7fb56478b5c6a5f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4726367 Nov 11 11:43:30.352467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a03d051-f4c0-4b62-b004-5791d4456648,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:30.362433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.363126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.363723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.364261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.364809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.365352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.365900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.366441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.366976 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.367581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.368126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.374223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:30.455086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:30.493677 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:30.588089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:30.593973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b1b8151e-6576-4e91-ae37-f255fd0f6242 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:30.608945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a03d051-f4c0-4b62-b004-5791d4456648,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:30.614420 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:30.615874 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2a03d051-f4c0-4b62-b004-5791d4456648 HTTP/1.1" status: 204 len: 168 time: 0.2680199 Nov 11 11:43:30.622937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.623392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.623812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.624224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.624639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.625047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.625452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.625998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.626402 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.626799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.627213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:43:30.630641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:32.556272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 35276) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:32.734570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:32.769795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:32.773974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Usage tracker for resource:security_group_rule and tenant:1681c554c04e444689e4725beb629106 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:32.777140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:32.783795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:32.869349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:32.955431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:32.964033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-68b160f8-9e19-4655-8f49-3055d18ec00e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:33.009424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed1e6fea-d17d-4776-9a09-fc7d75043be8,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:33.014680 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=1681c554c04e444689e4725beb629106&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4575150 Nov 11 11:43:33.015692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:33.018525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 35284) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:33.083085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f7466421-8e5f-4126-b4e3-ec1bfec40bbb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:33.111676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f7466421-8e5f-4126-b4e3-ec1bfec40bbb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:33.190377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f7466421-8e5f-4126-b4e3-ec1bfec40bbb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:33.195448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b68af4ca-3135-421f-ba87-d1e402b0f71e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:33.210485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7466421-8e5f-4126-b4e3-ec1bfec40bbb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed1e6fea-d17d-4776-9a09-fc7d75043be8,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:33.213659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f7466421-8e5f-4126-b4e3-ec1bfec40bbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:33.218308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f7466421-8e5f-4126-b4e3-ec1bfec40bbb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:33.219564 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-f7466421-8e5f-4126-b4e3-ec1bfec40bbb admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ed1e6fea-d17d-4776-9a09-fc7d75043be8 HTTP/1.1" status: 204 len: 168 time: 0.1999540 Nov 11 11:43:34.527514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:40.024058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcf215d-72cd-4851-bfec-f3bb56be8118 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:41.286943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:43.458242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e0138a28-d751-4816-8985-ad60a3849fdd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:43.503748 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:44.623387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:45.564341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:43:45.681324 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73c21dc5-5567-428f-b9cf-731263799103 req-68ffd135-7d9a-405a-b069-613fb9de1510 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1098 time: 0.1345787 Nov 11 11:43:45.688396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c44c5d59-dd8b-4e04-842f-35cd97cdaa5d req-b7824020-77bd-4f80-b65e-a2e9b4b83a66 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:45.689813 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c44c5d59-dd8b-4e04-842f-35cd97cdaa5d req-b7824020-77bd-4f80-b65e-a2e9b4b83a66 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1844943 Nov 11 11:43:45.857859 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c44c5d59-dd8b-4e04-842f-35cd97cdaa5d req-b32581fa-ec19-4e83-a49e-a71a7ea7e5ee tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1395254 Nov 11 11:43:45.900502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c21dc5-5567-428f-b9cf-731263799103 req-65c2648b-e300-416b-836e-3d7a8bec7727 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:45.900502 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73c21dc5-5567-428f-b9cf-731263799103 req-65c2648b-e300-416b-836e-3d7a8bec7727 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.2087426 Nov 11 11:43:45.990980 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73c21dc5-5567-428f-b9cf-731263799103 req-78f7d29c-2154-4407-9f59-c75c6b7924f6 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 200 len: 217 time: 0.0833948 Nov 11 11:43:46.083601 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c21dc5-5567-428f-b9cf-731263799103 req-f472547f-fdad-4473-8ae9-f87c30f33ce5 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:46.085202 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73c21dc5-5567-428f-b9cf-731263799103 req-f472547f-fdad-4473-8ae9-f87c30f33ce5 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.0877118 Nov 11 11:43:46.141718 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73c21dc5-5567-428f-b9cf-731263799103 req-2f9f5fe1-389e-4190-83e7-5803633b22a2 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0486498 Nov 11 11:43:46.305854 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73c21dc5-5567-428f-b9cf-731263799103 req-c868078b-b0fe-4847-9e94-d1c69d39cf86 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1577702 Nov 11 11:43:46.332736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 35530) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:46.498270 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:46.551282 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:46.559815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Usage tracker for resource:security_group_rule and tenant:e447f9a0156248b6aa819e7aab90ff11 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:46.566429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:46.581462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:46.681585 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73c21dc5-5567-428f-b9cf-731263799103 req-5de8890b-adda-4230-843f-0c6e57b43e6e service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3681355 Nov 11 11:43:46.689244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:46.726664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:46.735947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-684ea647-39b5-405a-ae49-e0b0b54c6679 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:46.789498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec0cfd58-1874-45fa-9e8e-5ff21d920cd5,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:46.793020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:46.803948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 35544) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:46.804262 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=e447f9a0156248b6aa819e7aab90ff11&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4706926 Nov 11 11:43:46.870596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a9cf522c-41a3-48e7-8049-a665e8b79ed1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:46.900734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a9cf522c-41a3-48e7-8049-a665e8b79ed1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:47.031074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a9cf522c-41a3-48e7-8049-a665e8b79ed1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:47.041019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b1c28ae2-5ee2-4e58-aeb9-1fdef17b4540 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:47.065339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9cf522c-41a3-48e7-8049-a665e8b79ed1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec0cfd58-1874-45fa-9e8e-5ff21d920cd5,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:47.069540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a9cf522c-41a3-48e7-8049-a665e8b79ed1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:47.074828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a9cf522c-41a3-48e7-8049-a665e8b79ed1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:47.076631 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a9cf522c-41a3-48e7-8049-a665e8b79ed1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ec0cfd58-1874-45fa-9e8e-5ff21d920cd5 HTTP/1.1" status: 204 len: 168 time: 0.2715030 Nov 11 11:43:47.119462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c8dd72-96de-42c1-ae61-f058aee48cc0 req-fc73a8ac-ceb2-4c83-8964-972244fe1efa tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:47.121582 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-58c8dd72-96de-42c1-ae61-f058aee48cc0 req-fc73a8ac-ceb2-4c83-8964-972244fe1efa tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1308496 Nov 11 11:43:47.177027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-58c8dd72-96de-42c1-ae61-f058aee48cc0 req-17d025b0-4103-4632-963f-0c8ea7e7d8ab tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450304 Nov 11 11:43:48.425060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6e5649-26f5-4e10-8fd9-ec41ccc6695a req-125e6b6f-af1d-4d0f-8ed2-6f83a67dcd24 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:48.432744 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b6e5649-26f5-4e10-8fd9-ec41ccc6695a req-125e6b6f-af1d-4d0f-8ed2-6f83a67dcd24 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1123013 Nov 11 11:43:48.483609 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b6e5649-26f5-4e10-8fd9-ec41ccc6695a req-7c4c2c81-ed69-4ef7-847d-002843b9e8f3 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493829 Nov 11 11:43:49.506315 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-fe30de50-4627-42b8-9998-89980dd6eb0f tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2053754159&fields=id&tenant_id=1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 267 time: 0.0509412 Nov 11 11:43:49.716137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-b07e8a4e-ab2c-40ac-b86b-31d7f43fbe76 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:49.718211 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-b07e8a4e-ab2c-40ac-b86b-31d7f43fbe76 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 812 time: 0.1874084 Nov 11 11:43:49.736754 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1fd3d15a-ce80-48fb-95e2-ea0c218ae389 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/quotas/1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 375 time: 0.0121202 Nov 11 11:43:49.834023 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-10eb774e-9daa-44c2-8ed4-6a39fb25250e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0912323 Nov 11 11:43:50.088005 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-282e9f53-16f3-4bb3-85b8-814845b4084f service neutron] 10.222.0.11 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2384770 Nov 11 11:43:50.095620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9f07cf-7556-4fe5-bc7a-bd3dc4b1c75f req-8f59dc7b-9399-4b7a-99c4-311f76ff2305 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:50.097175 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9f9f07cf-7556-4fe5-bc7a-bd3dc4b1c75f req-8f59dc7b-9399-4b7a-99c4-311f76ff2305 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.2217569 Nov 11 11:43:50.263740 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9f9f07cf-7556-4fe5-bc7a-bd3dc4b1c75f req-8995f99a-0fb7-4ca2-9fea-b9424d0e7084 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1431339 Nov 11 11:43:50.294522 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-c95e493e-2000-4df5-82d6-43693b15d31c service neutron] 10.222.0.11 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1956496 Nov 11 11:43:50.939210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 35694) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:51.144641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:51.164693 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e280f186-7065-47ad-999c-2adb8003ce75 req-c9d35b04-8fb8-4e3e-bfde-f2b65eab418e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 210 time: 0.0603194 Nov 11 11:43:51.188076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:51.192209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Usage tracker for resource:security_group_rule and tenant:db23805fba5a45c7945ceb8aa38c90c8 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:51.195339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:51.201584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:51.363543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:51.431226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:51.447330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:51.503443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97dd7cf2-7c0f-4d3f-aba1-4f42aa4fcf80,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:51.506823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:51.516391 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=db23805fba5a45c7945ceb8aa38c90c8&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5735376 Nov 11 11:43:51.517221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 35712) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:51.553055 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506cd8e1-b36c-4d37-a23d-e60795f2aba2 req-6693f9eb-4d18-4fc1-b8aa-bc2cf8598a41 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:51.555072 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-506cd8e1-b36c-4d37-a23d-e60795f2aba2 req-6693f9eb-4d18-4fc1-b8aa-bc2cf8598a41 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1626916 Nov 11 11:43:51.597058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-27f66bb6-8898-40cd-adca-47bffa7db8d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:51.608187 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-506cd8e1-b36c-4d37-a23d-e60795f2aba2 req-8265ae98-909c-4f1c-adaf-7c565e9ef9cd tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456951 Nov 11 11:43:51.625153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-27f66bb6-8898-40cd-adca-47bffa7db8d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:51.821095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-27f66bb6-8898-40cd-adca-47bffa7db8d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:51.827162 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fce31845-7fd1-4262-b9e5-076785d745be tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:51.840540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27f66bb6-8898-40cd-adca-47bffa7db8d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97dd7cf2-7c0f-4d3f-aba1-4f42aa4fcf80,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:51.847296 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-27f66bb6-8898-40cd-adca-47bffa7db8d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:51.851696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-27f66bb6-8898-40cd-adca-47bffa7db8d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:51.855454 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-27f66bb6-8898-40cd-adca-47bffa7db8d8 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/97dd7cf2-7c0f-4d3f-aba1-4f42aa4fcf80 HTTP/1.1" status: 204 len: 168 time: 0.3339624 Nov 11 11:43:55.256040 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-872b956c-eb05-4d7c-9759-28683a03e864 req-c33b4e22-5e8b-4439-8f1f-9c5ae980aaa0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 210 time: 0.0938270 Nov 11 11:43:55.299091 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e2fdf2b-0d7f-4930-8b53-43965491aa95 req-74e9631e-20b1-46da-949b-5775fcda6221 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:55.300817 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e2fdf2b-0d7f-4930-8b53-43965491aa95 req-74e9631e-20b1-46da-949b-5775fcda6221 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1368408 Nov 11 11:43:55.374207 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e2fdf2b-0d7f-4930-8b53-43965491aa95 req-bbf622c9-2f69-489e-9744-21349a913e03 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668314 Nov 11 11:43:56.477927 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b97313b3-6875-40cf-b574-6b8062a7d370 req-38265359-f33d-4955-b040-adb34a4656b9 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 210 time: 0.0652890 Nov 11 11:43:56.612975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-095557c6-1d52-4c49-82db-aefa74e72933 req-087954cb-6919-432c-8181-ca54acc302cf tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:56.614775 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-095557c6-1d52-4c49-82db-aefa74e72933 req-087954cb-6919-432c-8181-ca54acc302cf tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0932801 Nov 11 11:43:56.670200 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-095557c6-1d52-4c49-82db-aefa74e72933 req-9e3a8f81-2467-455f-ba9f-4066e9937a39 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486486 Nov 11 11:43:57.672992 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-28ed90f2-b085-4b58-81ce-9b04108a0d1f req-4d10c7d2-ce91-4009-aaaa-118a80ae3fa8 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 210 time: 0.0455813 Nov 11 11:43:58.014521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-7cc250df-6a9b-4694-ad60-a8a2e52a5324 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:58.016166 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-7cc250df-6a9b-4694-ad60-a8a2e52a5324 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 812 time: 0.2206235 Nov 11 11:43:58.023530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cf4b19-7aed-419e-a24f-8accdbec103a req-c6093a27-a027-41fa-bc0e-e64fc0645814 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:58.025072 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-39cf4b19-7aed-419e-a24f-8accdbec103a req-c6093a27-a027-41fa-bc0e-e64fc0645814 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.2063081 Nov 11 11:43:58.116006 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-736aa8fd-301a-421a-8797-a28fbe5f7d9d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 380 time: 0.0848839 Nov 11 11:43:58.118275 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-39cf4b19-7aed-419e-a24f-8accdbec103a req-2a3ae13a-2056-456b-9f45-4494cdb69a73 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715415 Nov 11 11:43:58.125639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'port': {'device_id': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'admin_state_up': True, 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'security_groups': ['82ca2c36-3087-406f-9689-58bdf145dcc0']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:58.269483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:58.273387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:port and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:58.276334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:58.282917 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:58.326367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Made reservation on behalf of 1bcfb2b970f34aa9af017e16d6e4c699 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:43:58.331973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:58.507947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Allocated IP 172.20.0.5 (d5ec5e34-ac26-4927-b077-b0742eacb0fd/6e9509c6-37ce-4e40-8036-e5d45e65095d/91111d35-9f12-490d-be7e-18a93e7ee046) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:43:58.713445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:58.754022 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Transition to ACTIVE for port object 91111d35-9f12-490d-be7e-18a93e7ee046 will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:43:58.847741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:58.861908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:58.946991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:43:58.953009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:43:58.955776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=91111d35-9f12-490d-be7e-18a93e7ee046,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:58.958072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:43:58.986673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:59.040493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5912cf-0e38-4e77-b16b-65cb16168bc5 req-966bdcf7-b2b2-4692-8442-3dcf0fc2c44b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:59.040493 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4b5912cf-0e38-4e77-b16b-65cb16168bc5 req-966bdcf7-b2b2-4692-8442-3dcf0fc2c44b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 931 time: 0.2283132 Nov 11 11:43:59.049379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:59.050177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.132208 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4b5912cf-0e38-4e77-b16b-65cb16168bc5 req-46426dc7-d0e2-43bc-85d2-19d42f3fe3bb tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0886199 Nov 11 11:43:59.150267 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0293040 Nov 11 11:43:59.164470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Request body: {'port': {'device_id': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:43:59.262118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 35842) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:59.294689 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.442079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.463506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8576e7e-ba0e-4d44-8030-566dac6f8fed req-695dde67-131a-4c1e-ac87-2327a81eeb65 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:43:59.465043 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b8576e7e-ba0e-4d44-8030-566dac6f8fed req-695dde67-131a-4c1e-ac87-2327a81eeb65 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1150596 Nov 11 11:43:59.508834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-14d2d622-bcea-4bc1-b0fa-34403e188def None None] Provisioning for port 91111d35-9f12-490d-be7e-18a93e7ee046 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:43:59.514344 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-14d2d622-bcea-4bc1-b0fa-34403e188def None None] Provisioning complete for port 91111d35-9f12-490d-be7e-18a93e7ee046 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:43:59.524074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-14d2d622-bcea-4bc1-b0fa-34403e188def None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.524216 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b8576e7e-ba0e-4d44-8030-566dac6f8fed req-38b04f9f-613e-4fe3-8575-31d64aaf2749 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441642 Nov 11 11:43:59.577440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-14d2d622-bcea-4bc1-b0fa-34403e188def None None] Port 91111d35-9f12-490d-be7e-18a93e7ee046 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:43:59.591648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:43:59.601647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Usage tracker for resource:security_group_rule and tenant:9aecd6f000c44976856803614f5ba37a is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:43:59.606545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:43:59.613534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:43:59.700877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.731575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.740367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6881b0ce-0c83-4b01-b3f5-3690bebf5fa5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:43:59.783619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45b4ac87-4385-4b74-acd2-1bcc80435c67,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:43:59.786976 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:43:59.790666 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9aecd6f000c44976856803614f5ba37a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5272834 Nov 11 11:43:59.793529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 35852) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:43:59.854897 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 91111d35-9f12-490d-be7e-18a93e7ee046 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:43:59.858653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48be5493-bd76-4595-b14e-86b9e19f99e9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.862565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.877764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Transition to ACTIVE for port object 91111d35-9f12-490d-be7e-18a93e7ee046 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:43:59.889205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48be5493-bd76-4595-b14e-86b9e19f99e9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.914670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:43:59.920415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-131ef4fa-cec2-4aaf-b76c-9f687c0484e8 tempest-DeleteServersTestJSON-1576828170 tempest-DeleteServersTestJSON-1576828170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:00.034799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48be5493-bd76-4595-b14e-86b9e19f99e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:00.040297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aa41508d-efaa-4db7-b218-1add2a466f13 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:00.057686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48be5493-bd76-4595-b14e-86b9e19f99e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45b4ac87-4385-4b74-acd2-1bcc80435c67,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:00.057842 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Pushing event updated for resources: {'Port': ['ID=91111d35-9f12-490d-be7e-18a93e7ee046,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:00.062081 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:00.062674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-48be5493-bd76-4595-b14e-86b9e19f99e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:00.069611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48be5493-bd76-4595-b14e-86b9e19f99e9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:00.070876 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-48be5493-bd76-4595-b14e-86b9e19f99e9 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/45b4ac87-4385-4b74-acd2-1bcc80435c67 HTTP/1.1" status: 204 len: 168 time: 0.2763841 Nov 11 11:44:00.491185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Attempting to bind port 91111d35-9f12-490d-be7e-18a93e7ee046 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:44:00.491185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Attempting to bind port 91111d35-9f12-490d-be7e-18a93e7ee046 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:44:00.491185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Attempting to bind port 91111d35-9f12-490d-be7e-18a93e7ee046 on network d5ec5e34-ac26-4927-b077-b0742eacb0fd {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:44:00.503626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Port 91111d35-9f12-490d-be7e-18a93e7ee046 on network d5ec5e34-ac26-4927-b077-b0742eacb0fd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:44:00.504010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Attempting to bind port 91111d35-9f12-490d-be7e-18a93e7ee046 on network d5ec5e34-ac26-4927-b077-b0742eacb0fd {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:44:00.512334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b5233f-0beb-431a-b603-408c57a5d7de req-e665f5a1-d35d-4a26-92e4-80f46a0f28fa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:00.513711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-85b5233f-0beb-431a-b603-408c57a5d7de req-e665f5a1-d35d-4a26-92e4-80f46a0f28fa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Synchronizing usage tracker for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:44:00.542465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 43, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:44:00.544244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Checking segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:44:00.544244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Bound using segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:44:00.544244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Bound port: 91111d35-9f12-490d-be7e-18a93e7ee046, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:44:00.544244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:00.607382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 35868) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:00.634930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-85b5233f-0beb-431a-b603-408c57a5d7de req-e665f5a1-d35d-4a26-92e4-80f46a0f28fa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Unset dirty status for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:44:00.636195 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-85b5233f-0beb-431a-b603-408c57a5d7de req-e665f5a1-d35d-4a26-92e4-80f46a0f28fa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.3052583 Nov 11 11:44:00.665351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] For port 91111d35-9f12-490d-be7e-18a93e7ee046, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:44:00.724278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] For port 91111d35-9f12-490d-be7e-18a93e7ee046, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=91111d35-9f12-490d-be7e-18a93e7ee046,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:44:00.757675 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-85b5233f-0beb-431a-b603-408c57a5d7de req-35003e05-73e6-4d23-b122-688f7f22d00c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1122713 Nov 11 11:44:00.777857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:00.782137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:00.795011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:00.825312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:44:00.830144 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Usage tracker for resource:security_group_rule and tenant:22ec8e6de835464eb4150bd1f0f6389a is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:44:00.833415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:44:00.839840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:44:00.868796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:00.870573 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] 10.222.0.60 "PUT /v2.0/ports/91111d35-9f12-490d-be7e-18a93e7ee046 HTTP/1.1" status: 200 len: 1093 time: 1.7123485 Nov 11 11:44:00.874087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'tag': '91111d35-9f12-490d-be7e-18a93e7ee046'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:44:00.907231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-214be1cb-567f-4b2e-a81e-193171bde8e5 req-d807e1b6-75ae-4e8a-8c73-65d199d77dc4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:00.911770 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-214be1cb-567f-4b2e-a81e-193171bde8e5 req-d807e1b6-75ae-4e8a-8c73-65d199d77dc4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.2437565 Nov 11 11:44:00.948832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:00.949028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Pushing event updated for resources: {'Port': ['ID=91111d35-9f12-490d-be7e-18a93e7ee046,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:00.977329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:00.988521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ce38eda7-fb25-47cc-9ed8-7c08d4023411 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:00.998462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:01.026761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f1749d0-646f-4dce-89df-f66ef8c85154,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:01.033391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:01.039644 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-214be1cb-567f-4b2e-a81e-193171bde8e5 req-acc00980-ffcc-4834-89a0-c079316fd31f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1158583 Nov 11 11:44:01.076504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 35880) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:01.077341 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=22ec8e6de835464eb4150bd1f0f6389a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4687464 Nov 11 11:44:01.093693 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-538d04af-ca0c-482b-8210-8978299d7d09 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 1096 time: 0.1379545 Nov 11 11:44:01.195897 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-9da13ed8-608c-4eb9-a5df-9adca9397ed0 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=91111d35-9f12-490d-be7e-18a93e7ee046 HTTP/1.1" status: 200 len: 217 time: 0.0833032 Nov 11 11:44:01.256524 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'tag': '91111d35-9f12-490d-be7e-18a93e7ee046', 'status': 'completed', 'code': 200} Nov 11 11:44:01.285664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-083a2a98-a954-4610-ada4-053aa425e89b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:01.298803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bbf39e88-b3a5-42e1-a3f4-351d9d8e4236 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:01.300410 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bbf39e88-b3a5-42e1-a3f4-351d9d8e4236 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.0977340 Nov 11 11:44:01.355711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-083a2a98-a954-4610-ada4-053aa425e89b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:01.431088 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-70e732b0-c5bf-4a58-beaa-e81ace832509 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1186442 Nov 11 11:44:01.486727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-083a2a98-a954-4610-ada4-053aa425e89b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:01.493632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5707df26-c250-4642-aa21-6c6ea461adaa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:01.569345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-083a2a98-a954-4610-ada4-053aa425e89b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f1749d0-646f-4dce-89df-f66ef8c85154,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:01.574062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-083a2a98-a954-4610-ada4-053aa425e89b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:01.577882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-083a2a98-a954-4610-ada4-053aa425e89b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:01.579371 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-083a2a98-a954-4610-ada4-053aa425e89b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1f1749d0-646f-4dce-89df-f66ef8c85154 HTTP/1.1" status: 204 len: 168 time: 0.5021725 Nov 11 11:44:01.617144 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-cfd6fe44-5e83-45de-985e-6773962f2b42 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1774242 Nov 11 11:44:01.764909 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-74c070d3-5f3d-4670-bcab-3eafe5029bd9 req-bff2fff3-1f02-4299-b9b8-8b48b3a89593 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1400077 Nov 11 11:44:02.013904 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-887bc6ec-290a-4ab0-ab56-08c89e6dc003 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 1096 time: 0.1605570 Nov 11 11:44:02.020847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efcf51d-d987-47e6-9c97-89d46472c0c5 req-258578bf-0906-4f3d-92d0-2dbc927c1bae tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:02.022352 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8efcf51d-d987-47e6-9c97-89d46472c0c5 req-258578bf-0906-4f3d-92d0-2dbc927c1bae tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.1173928 Nov 11 11:44:02.181417 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8efcf51d-d987-47e6-9c97-89d46472c0c5 req-162cbb8d-5070-402f-8586-fb53b2277527 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1321256 Nov 11 11:44:02.202187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-87d49e42-d488-4c58-954e-9c7bfcb21a71 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:02.203782 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-87d49e42-d488-4c58-954e-9c7bfcb21a71 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 914 time: 0.1805079 Nov 11 11:44:02.276596 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-bb0af6b8-f375-41ed-b33e-5849c76cb112 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=91111d35-9f12-490d-be7e-18a93e7ee046 HTTP/1.1" status: 200 len: 217 time: 0.0655353 Nov 11 11:44:02.406700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-1126b435-f629-4bda-bc91-cbdffed9ea7a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:02.408291 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-1126b435-f629-4bda-bc91-cbdffed9ea7a service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.1256154 Nov 11 11:44:02.472757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188cf77a-2683-4fb4-bf6f-0436a6afa6f9 req-6d7b2416-e4e5-4f0c-ba45-d8826c8b22a2 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:02.474342 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-188cf77a-2683-4fb4-bf6f-0436a6afa6f9 req-6d7b2416-e4e5-4f0c-ba45-d8826c8b22a2 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1498930 Nov 11 11:44:02.556363 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-188cf77a-2683-4fb4-bf6f-0436a6afa6f9 req-a26583eb-7471-4a92-a8f8-c874d7e6b847 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734320 Nov 11 11:44:02.561144 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-6686901f-3400-4648-82c1-a2bbc76ad464 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1335707 Nov 11 11:44:02.711340 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-f69c366d-7aca-4074-942b-57e3b40ef966 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1393952 Nov 11 11:44:02.862181 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d91417a1-b534-4e00-add3-5dc86dc92613 req-8d93d73d-3413-4ddc-8f0c-abd4aa24946b service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1446161 Nov 11 11:44:03.392399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91bede0d-802c-47e7-be41-450260e4564c req-20ab6448-4db8-421e-b3d0-f878c5c8bcd0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:03.393999 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-91bede0d-802c-47e7-be41-450260e4564c req-20ab6448-4db8-421e-b3d0-f878c5c8bcd0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.0839887 Nov 11 11:44:03.444081 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-91bede0d-802c-47e7-be41-450260e4564c req-f004146e-8f47-49bb-8c4c-e092e6d47562 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439014 Nov 11 11:44:03.764038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae36f674-a1a1-4f66-92b0-994dc9ab1cd0 req-b5d0d0a0-d209-4c64-86a5-bebb85a1a553 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:03.765564 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae36f674-a1a1-4f66-92b0-994dc9ab1cd0 req-b5d0d0a0-d209-4c64-86a5-bebb85a1a553 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0842018 Nov 11 11:44:03.813992 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae36f674-a1a1-4f66-92b0-994dc9ab1cd0 req-b3811fa9-fd7b-4b4b-b8a7-262365ae57eb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423179 Nov 11 11:44:04.532750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:04.657871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0836b0-1bcc-4bfd-8ecd-d588ff90c0f9 req-2a0b391f-4e83-42a4-ba83-cc59e605809f tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:04.659483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f0836b0-1bcc-4bfd-8ecd-d588ff90c0f9 req-2a0b391f-4e83-42a4-ba83-cc59e605809f tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.0895331 Nov 11 11:44:04.709950 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f0836b0-1bcc-4bfd-8ecd-d588ff90c0f9 req-574603ca-06fa-44d5-8768-2504008619f3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444257 Nov 11 11:44:05.078539 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9957b6bb-a14a-40cd-8d8c-9917bb9e4ca0 req-772cbc73-9020-45fb-b22d-ea0ba4969aa8 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1098 time: 0.3399839 Nov 11 11:44:05.084305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aba72672-7fe5-4679-9f3c-42e0cbbd087c req-d2489d85-1270-460e-b084-b981561352e0 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:05.085811 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aba72672-7fe5-4679-9f3c-42e0cbbd087c req-d2489d85-1270-460e-b084-b981561352e0 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1162422 Nov 11 11:44:05.160134 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9957b6bb-a14a-40cd-8d8c-9917bb9e4ca0 req-9746a053-c658-4de9-997e-5ca1dbbb0abd service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732310 Nov 11 11:44:05.163941 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aba72672-7fe5-4679-9f3c-42e0cbbd087c req-ee626404-4e3f-4f37-b691-ab30cc9c7030 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633891 Nov 11 11:44:05.968358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ccaa7c-aa71-4df6-b04d-4fba87751277 req-e8a924d6-0457-4dc7-b490-4c140978c0d6 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:05.969984 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73ccaa7c-aa71-4df6-b04d-4fba87751277 req-e8a924d6-0457-4dc7-b490-4c140978c0d6 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.1344385 Nov 11 11:44:06.024920 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-38ab39ae-bce7-4f1d-b5c4-129544c7fdd0 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1265509 Nov 11 11:44:06.035313 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73ccaa7c-aa71-4df6-b04d-4fba87751277 req-8567c252-8a7b-4925-b3a3-e670fe1038db tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0584567 Nov 11 11:44:06.121930 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-8719931e-27a4-4815-8d63-f75a33146030 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 1098 time: 0.0739121 Nov 11 11:44:06.285392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-fa36a873-c6c9-4ad0-ab2c-97ccb4b326f1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:06.286982 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-fa36a873-c6c9-4ad0-ab2c-97ccb4b326f1 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.1390939 Nov 11 11:44:06.406659 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-1717d2ca-bacb-4da5-b303-0c573aee2129 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a HTTP/1.1" status: 200 len: 217 time: 0.0776250 Nov 11 11:44:06.488422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d8fd77-541f-4f0d-a109-43cd33511ed1 req-a8662885-4b78-4677-a9f4-fc8a386a53cb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:06.490024 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-99d8fd77-541f-4f0d-a109-43cd33511ed1 req-a8662885-4b78-4677-a9f4-fc8a386a53cb tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1986182 Nov 11 11:44:06.522922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-d3cf8b4a-42cc-4971-a83c-7d5adbbda500 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:06.524527 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-d3cf8b4a-42cc-4971-a83c-7d5adbbda500 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.1057293 Nov 11 11:44:06.586983 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-8a0af1bd-dce4-4317-8411-d372a5542e8e service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0494614 Nov 11 11:44:06.593043 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-99d8fd77-541f-4f0d-a109-43cd33511ed1 req-7b2fea54-d2a7-46d7-8fad-4806e56beb41 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959568 Nov 11 11:44:06.729569 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-ae470f7b-e0c7-48e4-b75a-c719a15b0fff service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1347907 Nov 11 11:44:06.881313 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f2cb01d4-7308-4619-820d-7d926ceda920 req-0246bc1d-22a3-414d-ab27-0b918419e115 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1403759 Nov 11 11:44:07.257597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84c5d2cb-12a5-4cc1-abad-588d35c90280 req-ffccc2cb-8c84-4582-873c-0e4e1249db52 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:07.259177 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-84c5d2cb-12a5-4cc1-abad-588d35c90280 req-ffccc2cb-8c84-4582-873c-0e4e1249db52 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.0858600 Nov 11 11:44:07.307584 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-84c5d2cb-12a5-4cc1-abad-588d35c90280 req-c5ccd95a-7dfa-4404-aa8a-f39faf4f7c59 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416963 Nov 11 11:44:07.799857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f84b6798-6b9a-4471-928c-a497a032f401 req-e3965de1-30c1-4e99-8234-ceec9c73242c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:07.802574 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f84b6798-6b9a-4471-928c-a497a032f401 req-e3965de1-30c1-4e99-8234-ceec9c73242c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0826461 Nov 11 11:44:07.853768 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f84b6798-6b9a-4471-928c-a497a032f401 req-e8b90ed4-7107-4c1a-a5cd-d93e88a8d678 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449071 Nov 11 11:44:08.604058 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-4f719e9c-5d8a-4b3d-bb7b-a4d094e997b2 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=d45efb8e286d41399941bdf844af2b3c&device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 1098 time: 0.2057407 Nov 11 11:44:08.618907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56278e1-a7cf-4051-9b35-d7591e997556 req-fce00c08-b1c6-4822-acef-e8ba1b48cbb1 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:08.620462 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b56278e1-a7cf-4051-9b35-d7591e997556 req-fce00c08-b1c6-4822-acef-e8ba1b48cbb1 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1799886 Nov 11 11:44:08.651057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44937a97-208d-4d29-93db-a40bdbff74df req-01819abc-934b-4f0a-b84c-7cf477a890a6 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:08.652611 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-44937a97-208d-4d29-93db-a40bdbff74df req-01819abc-934b-4f0a-b84c-7cf477a890a6 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.2109423 Nov 11 11:44:08.827620 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-44937a97-208d-4d29-93db-a40bdbff74df req-9f3526dc-b321-49aa-9297-f271a61d5e7b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1443803 Nov 11 11:44:08.834316 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b56278e1-a7cf-4051-9b35-d7591e997556 req-7a74824d-4e17-414c-8ee4-2f6077ed7df1 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1896157 Nov 11 11:44:08.836814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-5e24f751-09a1-4754-93b7-2787c1764b5e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:08.838305 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-5e24f751-09a1-4754-93b7-2787c1764b5e service neutron] 10.222.0.60 "GET /v2.0/networks?id=d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 200 len: 921 time: 0.2256081 Nov 11 11:44:08.914665 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-1b47a56b-96bd-4b23-84ee-7a73dfc40dcf service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 200 len: 217 time: 0.0681326 Nov 11 11:44:08.987086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-a3116b86-9e2e-40a6-baf4-cf317d06c296 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:08.988795 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-a3116b86-9e2e-40a6-baf4-cf317d06c296 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 200 len: 859 time: 0.0674713 Nov 11 11:44:09.038398 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-71a38420-3810-4660-a3a7-8ddd4ef22345 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d616b076-b5a7-4954-b999-21a3b4c0cf2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0421565 Nov 11 11:44:09.186906 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-78a5c606-921a-4ca0-b11c-db000e51bdae service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1411598 Nov 11 11:44:09.330425 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0faa7264-076a-4fdb-9fb3-11dcf4720d72 req-f5a0de47-c34e-4c0f-8a31-52d509084834 service neutron] 10.222.0.60 "GET /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1367810 Nov 11 11:44:10.043731 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cf2e977-49c3-46d5-b6aa-10735685002a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:10.112065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06292ee5-4ea5-4ba7-9c31-e53be327922d req-36a981ba-9d26-4534-9e78-244d2838efc0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:10.113653 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-06292ee5-4ea5-4ba7-9c31-e53be327922d req-36a981ba-9d26-4534-9e78-244d2838efc0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.1547883 Nov 11 11:44:10.119691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d667c8-7961-43b6-ae5f-f68cf1450ec4 req-a4f58db0-8426-46b7-9761-601950e00177 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:10.121113 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-95d667c8-7961-43b6-ae5f-f68cf1450ec4 req-a4f58db0-8426-46b7-9761-601950e00177 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1211901 Nov 11 11:44:10.198295 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-06292ee5-4ea5-4ba7-9c31-e53be327922d req-30b9511e-48bc-4f07-bd7f-36107104c081 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0761776 Nov 11 11:44:10.205740 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-95d667c8-7961-43b6-ae5f-f68cf1450ec4 req-967fbb27-7724-4c38-af0d-9fc7075014e2 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688069 Nov 11 11:44:11.274448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:11.472621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26e29b66-4627-4e71-96b9-e3d027756728 req-0efc77e0-d0a0-4906-9005-0a3921f16a0b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:11.474213 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-26e29b66-4627-4e71-96b9-e3d027756728 req-0efc77e0-d0a0-4906-9005-0a3921f16a0b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 943 time: 0.1495337 Nov 11 11:44:11.480916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1b2f1d-dd72-4d5b-ad0d-0ac2a05da150 req-9b2e0de1-2e1d-4c8e-91b6-d18a98064c61 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:11.482928 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dc1b2f1d-dd72-4d5b-ad0d-0ac2a05da150 req-9b2e0de1-2e1d-4c8e-91b6-d18a98064c61 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1228580 Nov 11 11:44:11.566638 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-26e29b66-4627-4e71-96b9-e3d027756728 req-92b5e9e4-a16e-4747-9480-392ce8066e7a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0825622 Nov 11 11:44:11.570399 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dc1b2f1d-dd72-4d5b-ad0d-0ac2a05da150 req-9e4a6d54-901c-4c19-919d-2af49bf4b60b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656378 Nov 11 11:44:12.006872 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 91111d35-9f12-490d-be7e-18a93e7ee046 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:44:12.149924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 91111d35-9f12-490d-be7e-18a93e7ee046, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=91111d35-9f12-490d-be7e-18a93e7ee046,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:12.164065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '91111d35-9f12-490d-be7e-18a93e7ee046', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'port_id': '91111d35-9f12-490d-be7e-18a93e7ee046', 'mac_address': 'fa:16:3e:38:60:4d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1015, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:44:12.219269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:12.241500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 91111d35-9f12-490d-be7e-18a93e7ee046 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:44:12.257497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 91111d35-9f12-490d-be7e-18a93e7ee046, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=91111d35-9f12-490d-be7e-18a93e7ee046,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:12.286013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:12.287951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7f5ff75c-654d-4670-8226-c2d84af86796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:12.355447 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=91111d35-9f12-490d-be7e-18a93e7ee046,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:12.365115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.365508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.365889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.366269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.366647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.367018 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.367412 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.367787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.368155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.368521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.368889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:12.373589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:12.769465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['91111d35-9f12-490d-be7e-18a93e7ee046'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:44:12.846465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb2cef00-e31c-471e-a677-1c4fc1021433 req-c4e85191-86c3-4aee-985f-aa3a2b53d29c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:12.848024 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eb2cef00-e31c-471e-a677-1c4fc1021433 req-c4e85191-86c3-4aee-985f-aa3a2b53d29c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 944 time: 0.1522822 Nov 11 11:44:12.853994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a32c7f1-71b8-40bb-8a93-967ddc289abd req-c0f6a726-25c8-4120-a94c-5308e7f3a56e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:12.855544 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8a32c7f1-71b8-40bb-8a93-967ddc289abd req-c0f6a726-25c8-4120-a94c-5308e7f3a56e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.1253774 Nov 11 11:44:12.945071 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eb2cef00-e31c-471e-a677-1c4fc1021433 req-40fc19ea-5f79-4ad8-b271-e009dae04cfb tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0884161 Nov 11 11:44:12.947698 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8a32c7f1-71b8-40bb-8a93-967ddc289abd req-d483eca6-bbe7-4538-b4cb-80e112ed001c tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761604 Nov 11 11:44:13.463044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99d7e4fc-b140-4d5f-9024-1e398e0d6c7b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:13.491571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:14.025381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 91111d35-9f12-490d-be7e-18a93e7ee046 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:44:14.123464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 91111d35-9f12-490d-be7e-18a93e7ee046 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:44:14.130392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 91111d35-9f12-490d-be7e-18a93e7ee046 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:44:14.130819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:14.167322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acc965ef-16a8-4e28-9c0b-27f3ca4a6d79 req-50a3492d-165e-49e7-9d06-c4832943d85d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:14.169603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-acc965ef-16a8-4e28-9c0b-27f3ca4a6d79 req-50a3492d-165e-49e7-9d06-c4832943d85d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 944 time: 0.0876544 Nov 11 11:44:14.228256 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-acc965ef-16a8-4e28-9c0b-27f3ca4a6d79 req-0a389dfb-4d74-4546-9d23-1d239a728353 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515432 Nov 11 11:44:14.249879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:14.279044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '91111d35-9f12-490d-be7e-18a93e7ee046'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:44:14.289164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 91111d35-9f12-490d-be7e-18a93e7ee046, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=91111d35-9f12-490d-be7e-18a93e7ee046,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:14.329520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:14.331642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:14.370528 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '91111d35-9f12-490d-be7e-18a93e7ee046', 'code': 200} Nov 11 11:44:14.404233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=91111d35-9f12-490d-be7e-18a93e7ee046,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:14.407554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:14.662849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:14.745515 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-26bcf8bc-d549-4404-81e6-72408a0cd0b3 req-739c7347-ce64-49fc-9207-72335e09bfba service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 1098 time: 0.0736010 Nov 11 11:44:14.790289 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-26bcf8bc-d549-4404-81e6-72408a0cd0b3 req-ce928987-ca60-43c0-a691-0a3fa1ad2405 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384200 Nov 11 11:44:15.444941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5132eac-2aee-440f-af20-82577b7db58a req-5a79cd02-bb29-49ff-be63-e6ff4816e98a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:15.446498 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f5132eac-2aee-440f-af20-82577b7db58a req-5a79cd02-bb29-49ff-be63-e6ff4816e98a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 945 time: 0.0845063 Nov 11 11:44:15.495263 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f5132eac-2aee-440f-af20-82577b7db58a req-31171aba-0501-4862-8baa-dbac2998ace2 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423074 Nov 11 11:44:16.713734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b75fd0cf-f359-4a8d-b62d-ab318eb35a45 req-0d28e220-d02a-47a1-b615-e099e3b364f5 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:16.715559 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b75fd0cf-f359-4a8d-b62d-ab318eb35a45 req-0d28e220-d02a-47a1-b615-e099e3b364f5 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 945 time: 0.0849929 Nov 11 11:44:16.769634 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b75fd0cf-f359-4a8d-b62d-ab318eb35a45 req-59ad108d-937f-4ea7-8ce0-c5ebe06d477b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470393 Nov 11 11:44:16.986586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb7f2d9-802f-401e-92b4-82f06a8d4973 req-f1cbfd6c-46ca-4de9-8916-46e2265cea38 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:16.988235 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5bb7f2d9-802f-401e-92b4-82f06a8d4973 req-f1cbfd6c-46ca-4de9-8916-46e2265cea38 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 945 time: 0.0866282 Nov 11 11:44:17.037873 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5bb7f2d9-802f-401e-92b4-82f06a8d4973 req-7768b57e-d151-4715-ba61-535addf6aec5 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430160 Nov 11 11:44:17.066818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 36014) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:17.348600 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-58ef0fcd-faa2-4411-af79-7fe1fe9ad643 tempest-TestVolumeBootPattern-1492948392 tempest-TestVolumeBootPattern-1492948392-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 1093 time: 0.2804551 Nov 11 11:44:17.351435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 36024) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:17.357591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'port_id': '91111d35-9f12-490d-be7e-18a93e7ee046', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address': '172.20.0.5'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:44:17.363315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:44:17.367375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:floatingip and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:44:17.370576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:44:17.376792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:44:17.605963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:17.758795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:17.910611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Allocated IP 172.27.3.136 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/7330e3ff-bb68-439e-a213-3f2b9a383c0e) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:44:18.070669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:18.131750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:18.135657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:18.204965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:44:18.208836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:44:18.214318 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:44:18.242455 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=7330e3ff-bb68-439e-a213-3f2b9a383c0e,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:18.248409 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:18.765876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:18.892400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:19.178951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04abd6b-6db7-427c-bc5f-c2953b080a94 req-eaac0a70-5062-4268-a744-1a4b0537b01e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:19.180671 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d04abd6b-6db7-427c-bc5f-c2953b080a94 req-eaac0a70-5062-4268-a744-1a4b0537b01e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1341777 Nov 11 11:44:19.213299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:19.241766 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d04abd6b-6db7-427c-bc5f-c2953b080a94 req-f5db1106-00ab-44c6-bad0-bf72716a1856 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503654 Nov 11 11:44:19.250944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:19.255670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-22fae1ea-067f-45ce-9170-71f7c42d750b tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:19.365753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=7330e3ff-bb68-439e-a213-3f2b9a383c0e,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:19.370146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:19.379111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:19.577644 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Floating IP b5b43a38-2aac-48cf-8d33-e058b0d90c9b associated. External IP: 172.27.3.136, port: 91111d35-9f12-490d-be7e-18a93e7ee046. Nov 11 11:44:19.982723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Router e7a84a32-cf44-4d0e-908d-7569d000b45d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:44:20.200780 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:44:20.212677 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:44:20.226416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:44:20.227105 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:44:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:20.263761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:20.339210 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.9779515 Nov 11 11:44:20.339210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'tag': '91111d35-9f12-490d-be7e-18a93e7ee046'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:44:20.570659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:44:20.623399 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'tag': '91111d35-9f12-490d-be7e-18a93e7ee046', 'status': 'completed', 'code': 200} Nov 11 11:44:20.725692 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-6051395a-63dd-40ec-b877-8e27059f1418 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 1098 time: 0.1043139 Nov 11 11:44:20.731784 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ed5110-10c9-455c-8635-bdbce91dcb31 req-b55a10df-7a76-4e94-b4c1-0ceaa6f809f4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:20.733283 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-88ed5110-10c9-455c-8635-bdbce91dcb31 req-b55a10df-7a76-4e94-b4c1-0ceaa6f809f4 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.3522458 Nov 11 11:44:20.884159 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-88ed5110-10c9-455c-8635-bdbce91dcb31 req-0d037563-80aa-4257-b682-3407f4e75415 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1262233 Nov 11 11:44:20.910584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-01a09300-c9a2-4a1b-b73b-0fc0d4ae4774 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:20.912215 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-01a09300-c9a2-4a1b-b73b-0fc0d4ae4774 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 914 time: 0.1770756 Nov 11 11:44:20.937034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'b5b43a38-2aac-48cf-8d33-e058b0d90c9b', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.136', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '91111d35-9f12-490d-be7e-18a93e7ee046', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:38:60:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:44:18Z', 'updated_at': '2021-11-11T11:44:18Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:20.941136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:44:20.952635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:44:20.953248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:44:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:21.020393 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-2cb4aaf0-6a9e-4203-b5a4-9c0a1b3ba756 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=91111d35-9f12-490d-be7e-18a93e7ee046 HTTP/1.1" status: 200 len: 999 time: 0.1006224 Nov 11 11:44:21.094510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-4ab90540-a674-45d9-ab71-3dc427bf2774 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:21.096244 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-4ab90540-a674-45d9-ab71-3dc427bf2774 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.0684853 Nov 11 11:44:21.138825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:44:21.179911 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-bf63aae0-124a-489c-beb4-db09d2144c46 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0757892 Nov 11 11:44:21.333844 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-48734f65-1789-4e1e-a452-237b91daedfa service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1470098 Nov 11 11:44:21.481345 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73be56ca-93b0-4227-ac9c-7271b72f935a req-59b9aac3-3708-49ee-be8e-bb01634f16d6 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1398571 Nov 11 11:44:21.517878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'b5b43a38-2aac-48cf-8d33-e058b0d90c9b', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.136', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '91111d35-9f12-490d-be7e-18a93e7ee046', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:38:60:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:44:18Z', 'updated_at': '2021-11-11T11:44:18Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:21.522346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51965a80-ac7f-4473-a044-c9bc824ec494 None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'b5b43a38-2aac-48cf-8d33-e058b0d90c9b', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.136', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '91111d35-9f12-490d-be7e-18a93e7ee046', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:38:60:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:44:18Z', 'updated_at': '2021-11-11T11:44:18Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:44:21.859465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f785224d-ff91-441e-87c3-7147e82eb319 None None] New status for floating IP b5b43a38-2aac-48cf-8d33-e058b0d90c9b: ACTIVE {{(pid=88330) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:44:22.143474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57443d9e-c7c1-4cc5-9210-6be2645f9116 req-bc8759ea-3ee6-4c20-a3d3-96fadbaff466 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:22.144998 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-57443d9e-c7c1-4cc5-9210-6be2645f9116 req-bc8759ea-3ee6-4c20-a3d3-96fadbaff466 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1307483 Nov 11 11:44:22.214598 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-57443d9e-c7c1-4cc5-9210-6be2645f9116 req-45eded94-9499-494d-9e0d-2d5ccd7c3f53 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630085 Nov 11 11:44:22.220797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-3cadcafd-7d59-48ed-ad8c-f37371175ad6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:22.222273 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-3cadcafd-7d59-48ed-ad8c-f37371175ad6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.60 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 945 time: 0.1336827 Nov 11 11:44:22.299582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Deleting port e3d4fb61-8388-4546-8f10-81ccafd1477a {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:44:22.299973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:22.555757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] For port e3d4fb61-8388-4546-8f10-81ccafd1477a, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e3d4fb61-8388-4546-8f10-81ccafd1477a,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:22.556165 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:22.565574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:44:22.689156 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Calling delete_port for e3d4fb61-8388-4546-8f10-81ccafd1477a owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:44:22.965399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:22.971690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:22.991263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['2149ca07-49c8-44c1-8765-765da866d5e8', 'e3d4fb61-8388-4546-8f10-81ccafd1477a'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:44:23.021272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Pushing event deleted for resources: {'Port': ['ID=e3d4fb61-8388-4546-8f10-81ccafd1477a,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:23.025062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:23.100757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] No DVR routers for this DVR port e3d4fb61-8388-4546-8f10-81ccafd1477a on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:44:23.104205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:23.107632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ac7a6af-a9e4-4c03-894d-e9bad44fac64', 'name': 'network-vif-deleted', 'tag': 'e3d4fb61-8388-4546-8f10-81ccafd1477a'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:44:23.153872 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a6d2b052-aff0-456a-ad29-692aa30d285f req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.60 "DELETE /v2.0/ports/e3d4fb61-8388-4546-8f10-81ccafd1477a HTTP/1.1" status: 204 len: 173 time: 0.9260919 Nov 11 11:44:23.165494 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ac7a6af-a9e4-4c03-894d-e9bad44fac64', 'name': 'network-vif-deleted', 'tag': 'e3d4fb61-8388-4546-8f10-81ccafd1477a', 'status': 'completed', 'code': 200} Nov 11 11:44:23.395641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-8d4539b2-31da-48e1-8707-5b1356b68faf req-cada9ad4-090b-4eac-894c-653de8e5598e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Synchronizing usage tracker for tenant:d45efb8e286d41399941bdf844af2b3c on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:44:23.491227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-8d4539b2-31da-48e1-8707-5b1356b68faf req-cada9ad4-090b-4eac-894c-653de8e5598e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Unset dirty status for tenant:d45efb8e286d41399941bdf844af2b3c on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:44:23.492584 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8d4539b2-31da-48e1-8707-5b1356b68faf req-cada9ad4-090b-4eac-894c-653de8e5598e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=3ac7a6af-a9e4-4c03-894d-e9bad44fac64 HTTP/1.1" status: 200 len: 210 time: 0.1454277 Nov 11 11:44:25.149902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f14210f6-02ae-4bcb-a60f-2271e456f5db req-4ac11399-d033-4bc1-a53e-cbab17262867 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:25.151563 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f14210f6-02ae-4bcb-a60f-2271e456f5db req-4ac11399-d033-4bc1-a53e-cbab17262867 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0876644 Nov 11 11:44:25.200443 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f14210f6-02ae-4bcb-a60f-2271e456f5db req-d1781e24-4d9f-4683-9664-8c9e61fce3dc tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424917 Nov 11 11:44:26.078785 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device e3d4fb61-8388-4546-8f10-81ccafd1477a no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:44:26.113757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: e3d4fb61-8388-4546-8f10-81ccafd1477a {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:44:26.114152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device e3d4fb61-8388-4546-8f10-81ccafd1477a not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:44:26.416047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47306577-33ad-41be-abcc-d10b05d8fb04 req-51d75e15-3faa-42e0-ab27-30f2a8aae852 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:26.417618 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-47306577-33ad-41be-abcc-d10b05d8fb04 req-51d75e15-3faa-42e0-ab27-30f2a8aae852 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0852146 Nov 11 11:44:26.465774 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-47306577-33ad-41be-abcc-d10b05d8fb04 req-6dce4081-e7e3-4130-b3e4-f80854b7e4fc tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412276 Nov 11 11:44:27.676032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc7f519-5a0d-4c17-85fb-ddefcbfe88ba req-add5a0fd-4397-4353-aa33-cf5dc8ffc801 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:27.677612 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-efc7f519-5a0d-4c17-85fb-ddefcbfe88ba req-add5a0fd-4397-4353-aa33-cf5dc8ffc801 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0846736 Nov 11 11:44:27.725229 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-efc7f519-5a0d-4c17-85fb-ddefcbfe88ba req-293744f4-36b6-46f7-8fcc-ea76d0b53779 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415423 Nov 11 11:44:28.935603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fe14cb3-470c-4fbc-83c2-a24801d34452 req-7fc1ad6d-26a8-4d31-aa59-c417f01f1785 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:28.937204 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7fe14cb3-470c-4fbc-83c2-a24801d34452 req-7fc1ad6d-26a8-4d31-aa59-c417f01f1785 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0874026 Nov 11 11:44:28.986222 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7fe14cb3-470c-4fbc-83c2-a24801d34452 req-7c1be550-f851-427c-ab74-05a56e7237de tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428481 Nov 11 11:44:30.203658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e0a10d-ed12-4308-ba77-951ab8c9b865 req-275622d0-6abc-4d5d-886c-9012004a63d6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:30.205271 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b7e0a10d-ed12-4308-ba77-951ab8c9b865 req-275622d0-6abc-4d5d-886c-9012004a63d6 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0833061 Nov 11 11:44:30.258471 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b7e0a10d-ed12-4308-ba77-951ab8c9b865 req-4d3cf3e1-0736-490c-b8a6-778ca3e3311f tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469580 Nov 11 11:44:31.323317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-36d0b342-5910-4a76-a200-2c25abec55ef tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:31.328422 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-36d0b342-5910-4a76-a200-2c25abec55ef tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.60 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.0884476 Nov 11 11:44:31.412734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Deleting port 2149ca07-49c8-44c1-8765-765da866d5e8 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:44:31.413132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:31.737405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1fb607-d5fb-4e18-93be-af3cef0c96c6 req-a91fe834-569a-4815-848e-05eed2bb5b0e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:31.739043 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4a1fb607-d5fb-4e18-93be-af3cef0c96c6 req-a91fe834-569a-4815-848e-05eed2bb5b0e tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/ports?device_id=66d508f1-193d-4909-a4cd-59458908d0df HTTP/1.1" status: 200 len: 945 time: 0.2913315 Nov 11 11:44:31.787020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] For port 2149ca07-49c8-44c1-8765-765da866d5e8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=2149ca07-49c8-44c1-8765-765da866d5e8,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:31.787468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:31.926111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Calling delete_port for 2149ca07-49c8-44c1-8765-765da866d5e8 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:44:31.971214 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4a1fb607-d5fb-4e18-93be-af3cef0c96c6 req-94f83c38-18ef-47f2-ac1c-4e38c639e264 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.11 "GET /v2.0/security-groups?id=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2246261 Nov 11 11:44:32.119497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:32.126050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bdce9ec5-938e-4ef9-a826-aaa1f75ab718 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:32.131670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['2149ca07-49c8-44c1-8765-765da866d5e8'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:44:32.169189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Pushing event deleted for resources: {'Port': ['ID=2149ca07-49c8-44c1-8765-765da866d5e8,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:32.181502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.181909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.182312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.182706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.183101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.183519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.183912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.185012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.185177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.185563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.185949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:32.218676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:32.255975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] No DVR routers for this DVR port 2149ca07-49c8-44c1-8765-765da866d5e8 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:44:32.258388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:32.261202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66d508f1-193d-4909-a4cd-59458908d0df', 'name': 'network-vif-deleted', 'tag': '2149ca07-49c8-44c1-8765-765da866d5e8'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:44:32.303539 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-65c3b6ea-48b1-4c9d-96b6-029b44964367 req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] 10.222.0.60 "DELETE /v2.0/ports/2149ca07-49c8-44c1-8765-765da866d5e8 HTTP/1.1" status: 204 len: 173 time: 0.9722631 Nov 11 11:44:32.316930 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66d508f1-193d-4909-a4cd-59458908d0df', 'name': 'network-vif-deleted', 'tag': '2149ca07-49c8-44c1-8765-765da866d5e8', 'status': 'completed', 'code': 200} Nov 11 11:44:33.085176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 36144) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:33.691868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:34.397644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77000c4e-bb45-4f06-9d2a-0d5966087b77 req-1bb03670-57aa-4be8-8dca-f6c06721175c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:34.399300 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-77000c4e-bb45-4f06-9d2a-0d5966087b77 req-1bb03670-57aa-4be8-8dca-f6c06721175c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1498721 Nov 11 11:44:34.502494 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-77000c4e-bb45-4f06-9d2a-0d5966087b77 req-5e1a0607-e14d-4111-8c46-3382c9f0c891 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0610912 Nov 11 11:44:34.577118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:34.587615 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Deleting port 22d627d7-6ff0-48cd-b93e-559401603c6a {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:44:34.588005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:34.779595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] For port 22d627d7-6ff0-48cd-b93e-559401603c6a, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=22d627d7-6ff0-48cd-b93e-559401603c6a,segment=NetworkSegment(908260cd-8125-4712-af58-79f96aa8b762),segment_id=908260cd-8125-4712-af58-79f96aa8b762)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:34.779966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:34.909558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Calling delete_port for 22d627d7-6ff0-48cd-b93e-559401603c6a owned by network:router_interface {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:44:35.320249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:35.325854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:35.370886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Pushing event deleted for resources: {'Port': ['ID=22d627d7-6ff0-48cd-b93e-559401603c6a,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:35.374500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:35.732024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:35.851494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496e3c43-b05c-4e99-868a-ffd226c5a401 req-902cef8a-4247-4ec2-a10a-1bd8180bdfe1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:35.853016 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-496e3c43-b05c-4e99-868a-ffd226c5a401 req-902cef8a-4247-4ec2-a10a-1bd8180bdfe1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1717734 Nov 11 11:44:35.975210 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-496e3c43-b05c-4e99-868a-ffd226c5a401 req-93e5afa3-555b-4e74-8402-8b52b9276de9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1079869 Nov 11 11:44:36.109334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 2149ca07-49c8-44c1-8765-765da866d5e8 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:44:36.300142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 2149ca07-49c8-44c1-8765-765da866d5e8 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:44:36.300552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 2149ca07-49c8-44c1-8765-765da866d5e8 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:44:36.618603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:44:36.831573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:44:36.843103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] Sync routers for ids ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:44:36.847008 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] 10.222.0.11 "PUT /v2.0/routers/2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7606144 Nov 11 11:44:36.849511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 36182) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:36.864779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] Routers {'2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:44:36.865545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:44:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:37.054099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] Set router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:44:37.060499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks [] for router, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:37.299113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a145d8-221b-4844-b5b5-fc8709f7664c req-341ccd5d-9663-4679-b51d-e58268f64197 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:37.300707 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49a145d8-221b-4844-b5b5-fc8709f7664c req-341ccd5d-9663-4679-b51d-e58268f64197 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1827190 Nov 11 11:44:37.371365 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:44:35Z', 'revision_number': 5, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port': {'id': '770d481d-69dd-4c7b-9367-a57bafa0c6e9', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:d9:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:37.375466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] Checking router: 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:44:37.378226 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49a145d8-221b-4844-b5b5-fc8709f7664c req-6bc50edf-14a7-4273-bd49-54f865065e54 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0691466 Nov 11 11:44:37.387680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] Routers {'2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:44:37.388358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:44:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:37.398269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:37.442865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Deleting port 770d481d-69dd-4c7b-9367-a57bafa0c6e9 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:44:37.443308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:37.639299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] For port 770d481d-69dd-4c7b-9367-a57bafa0c6e9, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=770d481d-69dd-4c7b-9367-a57bafa0c6e9,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:37.639704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:37.694282 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] Set router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a gateway port host: None {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:44:37.767628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Calling delete_port for 770d481d-69dd-4c7b-9367-a57bafa0c6e9 owned by network:router_gateway {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:44:37.803253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:44:37Z', 'revision_number': 6, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port_host': None}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:37.807450 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb8c549a-0a43-4585-9ec2-8a5fc6abc159 None None] The sync data for ids ['2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a'] in dv-cinder-817417-1-iscsi is: [{'id': '2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a', 'name': 'tempest-ServerRescueNegativeTestJSON-1889321535-router', 'tenant_id': 'd45efb8e286d41399941bdf844af2b3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:44:37Z', 'revision_number': 6, 'project_id': 'd45efb8e286d41399941bdf844af2b3c', 'gw_port_host': None}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:44:37.982856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:37.989779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:38.037699 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Pushing event deleted for resources: {'Port': ['ID=770d481d-69dd-4c7b-9367-a57bafa0c6e9,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:38.040516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:38.274747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:38.508473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 770d481d-69dd-4c7b-9367-a57bafa0c6e9 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:44:38.545287 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 770d481d-69dd-4c7b-9367-a57bafa0c6e9 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:44:38.546808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 770d481d-69dd-4c7b-9367-a57bafa0c6e9 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:44:38.547466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 22d627d7-6ff0-48cd-b93e-559401603c6a no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:44:38.557002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:38.581877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 22d627d7-6ff0-48cd-b93e-559401603c6a {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:44:38.582273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 22d627d7-6ff0-48cd-b93e-559401603c6a not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:44:38.608374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:38.722057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f98830-26ff-46dd-a074-992691725cdb req-4ccffab7-0369-4d16-b591-ca311428fec9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:38.723953 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e5f98830-26ff-46dd-a074-992691725cdb req-4ccffab7-0369-4d16-b591-ca311428fec9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1721048 Nov 11 11:44:38.776870 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e5f98830-26ff-46dd-a074-992691725cdb req-4f7eeb34-f734-4c1e-bf2a-86ec4c9d2052 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465055 Nov 11 11:44:38.794387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:38.794969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a {{(pid=88329) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 11:44:38.809807 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Notify callbacks [] for router, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:38.813776 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] 10.222.0.11 "DELETE /v2.0/routers/2b673cea-fc0f-4dd9-8d6b-fcdf1d3aac5a HTTP/1.1" status: 204 len: 168 time: 1.9606826 Nov 11 11:44:38.814576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36192) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:38.889687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Deleting subnet c0ace514-c466-40d3-9d56-40ff46839783 {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:44:38.893378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:38.947536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036850920695'] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.013853 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.120580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2678040', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2638849'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.126603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ec5768ce-ed72-419e-83d6-abdd5b2d7b2c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:39.169977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c0ace514-c466-40d3-9d56-40ff46839783,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:39.179794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.190258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.190681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.191094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.191532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.191944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.192350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.192753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.193158 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.193559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.193958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.194367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:44:39.198069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:39.204073 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-44eaf1d1-22c7-4880-bc81-ed7c8a5cb6fc admin admin] 10.222.0.11 "DELETE /v2.0/subnets/c0ace514-c466-40d3-9d56-40ff46839783 HTTP/1.1" status: 204 len: 168 time: 0.3883181 Nov 11 11:44:39.206862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36198) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:39.332887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.473449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.505660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d616b076-b5a7-4954-b999-21a3b4c0cf2f']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:39.521360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '908260cd-8125-4712-af58-79f96aa8b762') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:39.522297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '908260cd-8125-4712-af58-79f96aa8b762') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:44:39.543608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.564993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.572606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Releasing vlan 1021 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:44:39.573049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:44:39.588430 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:44:39.759633 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.764351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:39.784383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:39.787563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Pushing event deleted for resources: {'Network': ['ID=d616b076-b5a7-4954-b999-21a3b4c0cf2f,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:39.790847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:39.793985 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-066619ff-9474-4df4-bfb9-0ca6b455bc4c admin admin] 10.222.0.11 "DELETE /v2.0/networks/d616b076-b5a7-4954-b999-21a3b4c0cf2f HTTP/1.1" status: 204 len: 168 time: 0.5860460 Nov 11 11:44:40.028290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48ade98c-9a3a-4dc4-a436-4ce93183586c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:40.164927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36210) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:40.230880 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-7a2308ed-57b8-49ee-9472-9e9af81f1540 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d45efb8e286d41399941bdf844af2b3c&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0645559 Nov 11 11:44:40.234141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36214) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:40.246562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-854dd0d6-45d9-434f-8ca2-be0f952c4067 req-a0f10f75-b08a-48b4-83ef-89b0e7e08bb7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:40.248804 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-854dd0d6-45d9-434f-8ca2-be0f952c4067 req-a0f10f75-b08a-48b4-83ef-89b0e7e08bb7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.3261149 Nov 11 11:44:40.299343 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-854dd0d6-45d9-434f-8ca2-be0f952c4067 req-2926682a-71c9-4f93-82a7-9bd8cc3ca8b3 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438497 Nov 11 11:44:40.302306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-14f7b579-935d-44df-b382-1fdfa2554679 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:40.330961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-14f7b579-935d-44df-b382-1fdfa2554679 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:40.414863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-14f7b579-935d-44df-b382-1fdfa2554679 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:40.420882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8d1d75b5-61b4-4e2f-8578-d60fc105f6c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:40.434645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14f7b579-935d-44df-b382-1fdfa2554679 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:40.437326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-14f7b579-935d-44df-b382-1fdfa2554679 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:40.439572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-14f7b579-935d-44df-b382-1fdfa2554679 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:40.440791 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-14f7b579-935d-44df-b382-1fdfa2554679 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/87c7b4af-d5fd-4660-9f3e-c7dfec92e5ca HTTP/1.1" status: 204 len: 168 time: 0.2057829 Nov 11 11:44:41.290240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:41.545130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f644522a-ba75-43ba-9550-eedb21aafee6 req-6212644a-b2d0-4a76-8cc6-c6dc0ba69566 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:41.546837 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f644522a-ba75-43ba-9550-eedb21aafee6 req-6212644a-b2d0-4a76-8cc6-c6dc0ba69566 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0994158 Nov 11 11:44:41.600745 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f644522a-ba75-43ba-9550-eedb21aafee6 req-758af980-f1ff-4e50-be70-449a7b7f64be tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465162 Nov 11 11:44:42.846119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2903134-2a0f-4609-943f-2f2e7d628bff req-c7beab20-2b3a-4d1a-9620-61192c637385 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:42.847757 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c2903134-2a0f-4609-943f-2f2e7d628bff req-c7beab20-2b3a-4d1a-9620-61192c637385 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0864770 Nov 11 11:44:42.896531 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c2903134-2a0f-4609-943f-2f2e7d628bff req-8455a271-51c1-4b8a-aef7-0c7218dc0330 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424488 Nov 11 11:44:43.032984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c43fb372-5810-4f64-9ab5-03ee6b74afbf req-f6d05c65-168f-4d0b-bb94-e55fa2c5497d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:43.034600 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c43fb372-5810-4f64-9ab5-03ee6b74afbf req-f6d05c65-168f-4d0b-bb94-e55fa2c5497d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1190164 Nov 11 11:44:43.085183 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c43fb372-5810-4f64-9ab5-03ee6b74afbf req-bc5ad2ab-0712-4f74-9ec0-558d3fa88add tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443761 Nov 11 11:44:43.468591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b002137c-6fa1-4c93-9f83-411dcb8b2862 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:43.497077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:44.119452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe6939b-9329-4eaf-900c-9e795bd9e7d8 req-a5c64aff-e518-4bdf-8711-4bb558a8a9cf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:44.121152 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0fe6939b-9329-4eaf-900c-9e795bd9e7d8 req-a5c64aff-e518-4bdf-8711-4bb558a8a9cf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0856140 Nov 11 11:44:44.175006 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0fe6939b-9329-4eaf-900c-9e795bd9e7d8 req-5c1726aa-0609-4df2-aa20-b62d5e5c53d6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469317 Nov 11 11:44:44.401936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726c6f18-dd1b-4693-a926-408c17e509bb req-8c5393f0-735e-4736-bccd-8a330ff1a7db tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:44.408231 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-726c6f18-dd1b-4693-a926-408c17e509bb req-8c5393f0-735e-4736-bccd-8a330ff1a7db tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1401813 Nov 11 11:44:44.463017 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-726c6f18-dd1b-4693-a926-408c17e509bb req-81ab5d32-538b-4c38-8fae-2fbd5277fb86 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0527356 Nov 11 11:44:44.626286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:45.394012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd3fcac-74f0-4c09-8032-7132068d939d req-c219e0b7-adc0-44ff-82b9-4ffbf1f8adaa tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:45.395628 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3cd3fcac-74f0-4c09-8032-7132068d939d req-c219e0b7-adc0-44ff-82b9-4ffbf1f8adaa tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0819466 Nov 11 11:44:45.453421 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3cd3fcac-74f0-4c09-8032-7132068d939d req-41df0bfc-a1f6-4bfb-8b7e-0ca73d7565a1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515254 Nov 11 11:44:45.670877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d12227-deef-491a-9392-af38c998f977 req-d9507e39-e2a8-4488-8951-6db1d68af8fc tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:45.672531 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-34d12227-deef-491a-9392-af38c998f977 req-d9507e39-e2a8-4488-8951-6db1d68af8fc tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0812728 Nov 11 11:44:45.721878 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-34d12227-deef-491a-9392-af38c998f977 req-d8e55666-39f5-4b43-957c-a44b445ebd35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431731 Nov 11 11:44:46.687766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5114fd83-c72a-43b7-b2f7-34064893a4a5 req-8e3ba7f7-f5e6-4e11-a058-034bfb9e2e03 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:46.689250 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5114fd83-c72a-43b7-b2f7-34064893a4a5 req-8e3ba7f7-f5e6-4e11-a058-034bfb9e2e03 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0891104 Nov 11 11:44:46.741014 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5114fd83-c72a-43b7-b2f7-34064893a4a5 req-01f94501-f92e-4587-9469-fcbb51879be7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451796 Nov 11 11:44:46.930432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-955af797-3df3-420a-b1b7-23cf6357bfba req-62b38afa-778a-4b25-b0ea-b94efdec1c15 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:46.932159 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-955af797-3df3-420a-b1b7-23cf6357bfba req-62b38afa-778a-4b25-b0ea-b94efdec1c15 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0839329 Nov 11 11:44:46.984286 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-955af797-3df3-420a-b1b7-23cf6357bfba req-cfb705b8-5541-4e07-995a-ed8ca8a65b47 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453134 Nov 11 11:44:47.973216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b130c73a-ac5f-4b72-9171-f22e8c4dec81 req-4b90014f-61d8-4a60-9305-16641ed7d9f8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:47.974872 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b130c73a-ac5f-4b72-9171-f22e8c4dec81 req-4b90014f-61d8-4a60-9305-16641ed7d9f8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0904670 Nov 11 11:44:48.024175 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b130c73a-ac5f-4b72-9171-f22e8c4dec81 req-705db821-061b-4fd5-ae53-c0e6be0cbba2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430906 Nov 11 11:44:48.213086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f1ebb26-e2a9-4561-8b9c-789c237bd114 req-9268659a-d8cd-4afe-b33b-b1d280375142 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:48.214715 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4f1ebb26-e2a9-4561-8b9c-789c237bd114 req-9268659a-d8cd-4afe-b33b-b1d280375142 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0871930 Nov 11 11:44:48.268051 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4f1ebb26-e2a9-4561-8b9c-789c237bd114 req-ce35ac3a-edda-42b7-94ba-e0188fe7717e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461769 Nov 11 11:44:49.264830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90474b7-4286-4453-a33c-cea000ff5ddc req-d925a7e9-3d3c-40d0-9597-0dd2a77ff0f6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:49.266468 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d90474b7-4286-4453-a33c-cea000ff5ddc req-d925a7e9-3d3c-40d0-9597-0dd2a77ff0f6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0981591 Nov 11 11:44:49.317584 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d90474b7-4286-4453-a33c-cea000ff5ddc req-ce0bb198-f9a4-4baf-9fe7-b50cfcc6d105 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450082 Nov 11 11:44:49.490866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de2484a2-64d9-498c-8883-2d1eaf633542 req-44caa4b7-0bb2-4492-add7-28beaa92c1a6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:49.492682 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-de2484a2-64d9-498c-8883-2d1eaf633542 req-44caa4b7-0bb2-4492-add7-28beaa92c1a6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0954196 Nov 11 11:44:49.554107 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-de2484a2-64d9-498c-8883-2d1eaf633542 req-b0e4b06e-1289-4eea-8039-aa92f1ca1545 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505819 Nov 11 11:44:50.548290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc54ba2-674e-45e7-a583-a05493e6847a req-abf72a7a-8c2a-4a49-bc8b-bc19187d1854 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:50.549986 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3fc54ba2-674e-45e7-a583-a05493e6847a req-abf72a7a-8c2a-4a49-bc8b-bc19187d1854 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0894351 Nov 11 11:44:50.602199 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3fc54ba2-674e-45e7-a583-a05493e6847a req-092cc932-d41b-4a6a-8c5f-00e88ccf9910 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453334 Nov 11 11:44:50.775207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3b6bb5c-981f-4a84-b3be-91074092d89e req-87957e01-42eb-44dc-95a9-93939705732d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:50.776938 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d3b6bb5c-981f-4a84-b3be-91074092d89e req-87957e01-42eb-44dc-95a9-93939705732d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0922995 Nov 11 11:44:50.834717 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d3b6bb5c-981f-4a84-b3be-91074092d89e req-037bfd32-8436-447d-8e52-e21188972f6e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457711 Nov 11 11:44:51.823918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4892863-d615-4ff6-aca6-d1aa7cea22e2 req-f7b2267a-82e4-408b-9599-b240da13ef05 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:51.825495 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e4892863-d615-4ff6-aca6-d1aa7cea22e2 req-f7b2267a-82e4-408b-9599-b240da13ef05 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0853746 Nov 11 11:44:51.881397 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e4892863-d615-4ff6-aca6-d1aa7cea22e2 req-4f59a2ae-be17-46b1-b5f9-721316aa21d6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480230 Nov 11 11:44:52.142745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:44:52.186899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f5b54-ffbc-4d06-86d5-226450cf1903 req-ead4e22c-69fe-4ba1-80f1-def0456d1c5f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:52.188607 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-705f5b54-ffbc-4d06-86d5-226450cf1903 req-ead4e22c-69fe-4ba1-80f1-def0456d1c5f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0888858 Nov 11 11:44:52.240125 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-705f5b54-ffbc-4d06-86d5-226450cf1903 req-ac4e732f-c8c9-4572-9bec-4c07f327d3d5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447094 Nov 11 11:44:52.293608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:52.310317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '48b55264-0eab-46d7-abe8-ce455a036f49', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'port_id': '48b55264-0eab-46d7-abe8-ce455a036f49', 'mac_address': 'fa:16:3e:18:a5:54', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1022, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:44:52.371812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:52.400789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 48b55264-0eab-46d7-abe8-ce455a036f49 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:44:52.417749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:52.451623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:52.454222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:52.534886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=6']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:52.538198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:52.545241 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['48b55264-0eab-46d7-abe8-ce455a036f49'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:44:53.004866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36376) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:53.104440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd1a149f-a6d9-4a90-9f39-74e2a17e12ec req-992843e1-122c-48e1-aa6b-c86a0552906b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:53.106073 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fd1a149f-a6d9-4a90-9f39-74e2a17e12ec req-992843e1-122c-48e1-aa6b-c86a0552906b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.0860910 Nov 11 11:44:53.161349 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fd1a149f-a6d9-4a90-9f39-74e2a17e12ec req-714cde39-ab80-446a-94e5-beecf6d0c263 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482473 Nov 11 11:44:53.162661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:53.199221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:44:53.203765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Usage tracker for resource:security_group_rule and tenant:0848507a82aa42488a884ebaa470cfac is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:44:53.206855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:44:53.212919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:44:53.288438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:53.323261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:53.331953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-27f66bb6-8898-40cd-adca-47bffa7db8d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:53.377225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e370dae-d036-430d-933a-4f0176c50fcd,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:53.382624 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=0848507a82aa42488a884ebaa470cfac&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3759978 Nov 11 11:44:53.384034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e9d973ac-b14e-41b1-bc24-3428a2e450db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:53.384815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36384) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:53.458759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d84a5149-a964-468b-9460-5e588a3533d7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:53.471468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16d0324-3d60-4da5-95d1-00a8bdbc63de req-cbc7325f-49bb-4c3c-be86-00da2f9f4e0b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:53.473085 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f16d0324-3d60-4da5-95d1-00a8bdbc63de req-cbc7325f-49bb-4c3c-be86-00da2f9f4e0b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0949600 Nov 11 11:44:53.488310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d84a5149-a964-468b-9460-5e588a3533d7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:53.528984 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f16d0324-3d60-4da5-95d1-00a8bdbc63de req-9ed12f32-0a88-45ff-b487-4d69a2eef579 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430737 Nov 11 11:44:53.649326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d84a5149-a964-468b-9460-5e588a3533d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:53.653548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-607868ad-7492-4dc5-8913-fb6a4f05e285 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:53.665456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84a5149-a964-468b-9460-5e588a3533d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e370dae-d036-430d-933a-4f0176c50fcd,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:53.667929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d84a5149-a964-468b-9460-5e588a3533d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:53.676285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d84a5149-a964-468b-9460-5e588a3533d7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:53.678441 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d84a5149-a964-468b-9460-5e588a3533d7 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0e370dae-d036-430d-933a-4f0176c50fcd HTTP/1.1" status: 204 len: 168 time: 0.2920659 Nov 11 11:44:54.150907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:44:54.264068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 48b55264-0eab-46d7-abe8-ce455a036f49 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:44:54.264068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:54.351101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:54.381355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:44:54.392730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:44:54.395538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e2bc58-8882-489a-b0a2-70ce92c96a15 req-83ee491c-f907-4332-ac2b-85dd33de4429 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:54.397276 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-50e2bc58-8882-489a-b0a2-70ce92c96a15 req-83ee491c-f907-4332-ac2b-85dd33de4429 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.0934460 Nov 11 11:44:54.432021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:54.434531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:54.453421 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-50e2bc58-8882-489a-b0a2-70ce92c96a15 req-7abd531b-f54a-498f-a266-ee89c1a7fc45 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485611 Nov 11 11:44:54.473237 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49', 'code': 200} Nov 11 11:44:54.511546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=7']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:54.515856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:54.748949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25d0264-672f-4af5-95d1-d8079b1657d7 req-9174028b-f834-4783-97ee-469d4fcd03a9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:54.750584 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f25d0264-672f-4af5-95d1-d8079b1657d7 req-9174028b-f834-4783-97ee-469d4fcd03a9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0880997 Nov 11 11:44:54.802139 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f25d0264-672f-4af5-95d1-d8079b1657d7 req-403b8cda-0fc3-40fc-b047-1f248d0e9aba tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452273 Nov 11 11:44:55.720618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f55728e-b9d7-4002-b3e4-6ff3026ac7fa req-e8b89d4c-b606-4827-b817-0dbbb41f7242 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:55.722654 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f55728e-b9d7-4002-b3e4-6ff3026ac7fa req-e8b89d4c-b606-4827-b817-0dbbb41f7242 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1132867 Nov 11 11:44:55.782206 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f55728e-b9d7-4002-b3e4-6ff3026ac7fa req-7e8fef5f-b276-4dcb-8dd7-9a2b39e91d51 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498953 Nov 11 11:44:55.870824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36444) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:56.114291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b93a98-e76b-484f-84c6-7b5bcdff4306 req-21c909c5-27bf-477e-b6f7-47d36dca984a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:56.114951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:56.116013 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-31b93a98-e76b-484f-84c6-7b5bcdff4306 req-21c909c5-27bf-477e-b6f7-47d36dca984a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1346264 Nov 11 11:44:56.196483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-31b93a98-e76b-484f-84c6-7b5bcdff4306 req-881de6e1-4ce2-4301-96ea-f33aa3437485 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0721483 Nov 11 11:44:56.197328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:44:56.206114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Usage tracker for resource:security_group_rule and tenant:036659c58d35455aaa68d530c00f791f is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:44:56.209190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:44:56.221627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:44:56.329943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:56.370945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:56.379535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d70e4da3-5809-4352-8b50-b41696e3c379 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:56.428026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8a7ef8f-59fa-49a3-95b2-7e572c840469,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:56.432751 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=036659c58d35455aaa68d530c00f791f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5601633 Nov 11 11:44:56.433816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:56.435848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 36452) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:44:56.524732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb7c8725-ef45-4080-8849-8514b18419bd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:56.560519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb7c8725-ef45-4080-8849-8514b18419bd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:56.754569 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb7c8725-ef45-4080-8849-8514b18419bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:56.758996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-53460d6e-2bb2-4518-bf9f-69b9c8ef5182 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:44:56.773056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7c8725-ef45-4080-8849-8514b18419bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8a7ef8f-59fa-49a3-95b2-7e572c840469,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:44:56.775674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cb7c8725-ef45-4080-8849-8514b18419bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:44:56.781751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb7c8725-ef45-4080-8849-8514b18419bd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:44:56.783032 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cb7c8725-ef45-4080-8849-8514b18419bd admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e8a7ef8f-59fa-49a3-95b2-7e572c840469 HTTP/1.1" status: 204 len: 168 time: 0.3456724 Nov 11 11:44:57.102905 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cef6c16-2639-4be5-b770-ce88c8c2831d req-da0a18a3-2f97-4544-a48d-3e5fad4a2cd8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:57.106391 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8cef6c16-2639-4be5-b770-ce88c8c2831d req-da0a18a3-2f97-4544-a48d-3e5fad4a2cd8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1499472 Nov 11 11:44:57.204199 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8cef6c16-2639-4be5-b770-ce88c8c2831d req-cecae77f-20c7-42f6-a138-fdb49a603f17 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0846374 Nov 11 11:44:57.582951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccac697e-fb15-48ea-8513-080312485d7c req-ad46ab31-af2c-4b01-b2ff-20e6756150ef tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:57.586834 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ccac697e-fb15-48ea-8513-080312485d7c req-ad46ab31-af2c-4b01-b2ff-20e6756150ef tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1884224 Nov 11 11:44:57.682127 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ccac697e-fb15-48ea-8513-080312485d7c req-8dfd4936-7595-4cf6-81da-a629b9c08ae3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0811443 Nov 11 11:44:58.636907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13403858-ef3d-494f-a899-67a8bb20bdd1 req-dfed2d48-7e62-4e18-ad9f-dfb35e37f144 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:58.650202 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13403858-ef3d-494f-a899-67a8bb20bdd1 req-dfed2d48-7e62-4e18-ad9f-dfb35e37f144 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1863720 Nov 11 11:44:58.760921 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13403858-ef3d-494f-a899-67a8bb20bdd1 req-cbc4501a-3932-43bd-a5b9-c6402a29c136 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1061471 Nov 11 11:44:59.128466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff57c63-6b2a-484f-a475-06d5973b00c7 req-17642248-ca81-4155-9d30-e24d07eace2d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:44:59.131261 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7ff57c63-6b2a-484f-a475-06d5973b00c7 req-17642248-ca81-4155-9d30-e24d07eace2d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.2027905 Nov 11 11:44:59.212921 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7ff57c63-6b2a-484f-a475-06d5973b00c7 req-b57c9a76-1f6a-4b87-9546-5e1cee60934b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0699282 Nov 11 11:44:59.595866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:45:00.232583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c192285-d613-4ed2-8329-041955c18a41 req-beac8aea-c899-426b-8b53-7e42da20df29 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:00.241348 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3c192285-d613-4ed2-8329-041955c18a41 req-beac8aea-c899-426b-8b53-7e42da20df29 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.2671068 Nov 11 11:45:00.319868 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3c192285-d613-4ed2-8329-041955c18a41 req-36b35f47-9833-4ee1-ac9a-c0c99eb16dfb tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0770786 Nov 11 11:45:00.362909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921e9b16-4c33-4b24-9af8-64089f3a1e30 req-e754676e-f8b3-489e-a8f0-cadd85724409 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:00.364780 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-921e9b16-4c33-4b24-9af8-64089f3a1e30 req-e754676e-f8b3-489e-a8f0-cadd85724409 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.2988884 Nov 11 11:45:00.379260 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-1ad1530c-2310-46f8-848b-84099f9c1ec6 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 1099 time: 0.2285357 Nov 11 11:45:00.479734 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-921e9b16-4c33-4b24-9af8-64089f3a1e30 req-801a1887-8bbf-4cba-b635-fd047c1d23bc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1018634 Nov 11 11:45:00.649954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-16c04c8c-678e-49ef-b265-17ee6587e291 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:00.652170 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-16c04c8c-678e-49ef-b265-17ee6587e291 service neutron] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 913 time: 0.2393422 Nov 11 11:45:00.801680 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-4393b97e-cbdc-47da-ae3a-d5b9f7149e66 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c HTTP/1.1" status: 200 len: 1001 time: 0.1410332 Nov 11 11:45:00.950746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-59ec218d-2ada-4178-86dc-32b311eb0d28 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:00.950746 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-59ec218d-2ada-4178-86dc-32b311eb0d28 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.1242454 Nov 11 11:45:01.081305 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-3a61fa8d-abb7-4108-944a-517b8d9c67cb service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1254184 Nov 11 11:45:01.326187 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-90af6fdc-22c6-4d82-8024-090f9a754ba7 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2323704 Nov 11 11:45:01.556612 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-28c33b72-c28a-40b4-b276-1baabdca9e1e req-108505b4-6540-4507-8ba0-6715e093c6f6 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2226365 Nov 11 11:45:02.355923 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d96f3a-857c-4a7e-9b70-d51a5bdf5ee5 req-86104a52-afc5-48ab-8352-37e120cc3eaf tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:02.358350 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-46d96f3a-857c-4a7e-9b70-d51a5bdf5ee5 req-86104a52-afc5-48ab-8352-37e120cc3eaf tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.3945088 Nov 11 11:45:02.364985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d198a953-0917-4f10-858d-888e3eb033eb req-bf91e835-9242-4b2b-971c-603e7f6560ed tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:02.366716 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d198a953-0917-4f10-858d-888e3eb033eb req-bf91e835-9242-4b2b-971c-603e7f6560ed tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.4007390 Nov 11 11:45:02.439927 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-46d96f3a-857c-4a7e-9b70-d51a5bdf5ee5 req-48302292-aa3f-41dc-bee2-8166a45001fa tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0689709 Nov 11 11:45:02.548636 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d198a953-0917-4f10-858d-888e3eb033eb req-58a1bdf4-4004-4abb-8fa9-58860523668a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1012006 Nov 11 11:45:03.743934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b8eb86-8d6a-4219-8501-81c28e467aa4 req-509a99c2-0711-420c-b7ae-fd9ab3bbd5fc tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:03.752211 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-10b8eb86-8d6a-4219-8501-81c28e467aa4 req-509a99c2-0711-420c-b7ae-fd9ab3bbd5fc tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1117651 Nov 11 11:45:03.954779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a3fea3-5d31-4e3d-b982-c4d8ce9b6f3f req-f686324c-83e8-43cb-9619-62e32198113f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:03.956700 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f6a3fea3-5d31-4e3d-b982-c4d8ce9b6f3f req-f686324c-83e8-43cb-9619-62e32198113f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.2030590 Nov 11 11:45:03.969125 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-10b8eb86-8d6a-4219-8501-81c28e467aa4 req-54b492fc-6d93-48c3-b195-4edb72016803 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2131531 Nov 11 11:45:04.043554 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f6a3fea3-5d31-4e3d-b982-c4d8ce9b6f3f req-403dc56a-947a-42a9-bd50-df854f3d7cdf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708067 Nov 11 11:45:04.553597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:05.358942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f9a9e5-06bd-43e8-80a8-4c4e64896b0b req-8d6e64d7-b3ad-4e76-bef8-5da14b76772c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:05.360635 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3f9a9e5-06bd-43e8-80a8-4c4e64896b0b req-8d6e64d7-b3ad-4e76-bef8-5da14b76772c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1287410 Nov 11 11:45:05.420801 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3f9a9e5-06bd-43e8-80a8-4c4e64896b0b req-dffe2e81-2ad2-422d-9f4a-2e825844609d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532804 Nov 11 11:45:05.756835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 36652) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:05.955510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:05.990871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:05.995062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Usage tracker for resource:security_group_rule and tenant:381284e35dfe4985ab7f34b2f5eca994 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:05.998438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:06.006161 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:06.086634 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:06.125833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:06.142924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-25fa853b-e880-43ea-9d24-11e7b93419b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:06.186614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f54db7f5-3777-40c9-8fb2-e0241ab15682,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:06.192819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:06.203331 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=381284e35dfe4985ab7f34b2f5eca994&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4448287 Nov 11 11:45:06.203806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 36658) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:06.297027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-78e93076-1229-4ebd-83af-0d3202cc66d3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:06.336128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-78e93076-1229-4ebd-83af-0d3202cc66d3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:06.449606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-78e93076-1229-4ebd-83af-0d3202cc66d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:06.459465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a2dd34a1-2d1e-4b6d-9c13-c344b8e87896 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:06.477818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e93076-1229-4ebd-83af-0d3202cc66d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f54db7f5-3777-40c9-8fb2-e0241ab15682,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:06.481279 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-78e93076-1229-4ebd-83af-0d3202cc66d3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:06.486456 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-78e93076-1229-4ebd-83af-0d3202cc66d3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f54db7f5-3777-40c9-8fb2-e0241ab15682 HTTP/1.1" status: 204 len: 168 time: 0.2815714 Nov 11 11:45:06.487767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-78e93076-1229-4ebd-83af-0d3202cc66d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:06.670770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0801b062-32af-42bf-94a1-7b0a7a4c1b85 req-afdcfb49-c45a-4113-a823-52791797afde tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:06.676631 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0801b062-32af-42bf-94a1-7b0a7a4c1b85 req-afdcfb49-c45a-4113-a823-52791797afde tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1074107 Nov 11 11:45:06.746579 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0801b062-32af-42bf-94a1-7b0a7a4c1b85 req-d8cb1941-9555-4f0c-bcc8-e4f71a34bded tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663979 Nov 11 11:45:07.189331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36668) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:07.219745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:07.220354 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-801e698b-7573-4064-8d8a-540c1acebd03 req-db61b306-7fd6-4f46-b861-4df50b9d192a service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1099 time: 0.1280403 Nov 11 11:45:07.269899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:07.274939 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Usage tracker for resource:security_group_rule and tenant:63c2300ca0ae4df4905edd43d1ed4cb4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:07.279113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:07.287345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:07.447267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:07.485419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:07.501291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2968d10e-20a7-41b4-ad42-933a79ba5a9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:07.553080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77769387-968c-4184-801f-134f4cd887ed,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:07.553849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801e698b-7573-4064-8d8a-540c1acebd03 req-3bc1136f-be88-40d3-bfd4-14a9b3201d16 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:07.560465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:07.569536 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-801e698b-7573-4064-8d8a-540c1acebd03 req-3bc1136f-be88-40d3-bfd4-14a9b3201d16 service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.2280731 Nov 11 11:45:07.608103 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=63c2300ca0ae4df4905edd43d1ed4cb4&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4173074 Nov 11 11:45:07.609042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36672) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:07.720419 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-801e698b-7573-4064-8d8a-540c1acebd03 req-54cee81f-5c25-4baa-8faf-6c23dcf69599 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=48b55264-0eab-46d7-abe8-ce455a036f49 HTTP/1.1" status: 200 len: 1001 time: 0.1434460 Nov 11 11:45:07.955122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801e698b-7573-4064-8d8a-540c1acebd03 req-78db5f6a-6e6e-4eaa-8192-c0488ca29d6a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:07.957520 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-801e698b-7573-4064-8d8a-540c1acebd03 req-78db5f6a-6e6e-4eaa-8192-c0488ca29d6a service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0982823 Nov 11 11:45:08.022576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fcf9bf11-ad77-44fa-aa73-57f7d408c62d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:08.081044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fcf9bf11-ad77-44fa-aa73-57f7d408c62d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:08.132704 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-801e698b-7573-4064-8d8a-540c1acebd03 req-225be822-4fc9-45b9-9e84-b8fd4f006fe1 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1282406 Nov 11 11:45:08.184114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37bf5b13-1277-49f3-b2e7-1b314616dd9b req-fb3b490e-3a2a-494e-a7be-5cffc0117abf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:08.185927 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-37bf5b13-1277-49f3-b2e7-1b314616dd9b req-fb3b490e-3a2a-494e-a7be-5cffc0117abf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.2287166 Nov 11 11:45:08.192833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fcf9bf11-ad77-44fa-aa73-57f7d408c62d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:08.205888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0912d826-41f0-41bf-b8fa-05da3b84866e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:08.229924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcf9bf11-ad77-44fa-aa73-57f7d408c62d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77769387-968c-4184-801f-134f4cd887ed,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:08.245488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fcf9bf11-ad77-44fa-aa73-57f7d408c62d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:08.259760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fcf9bf11-ad77-44fa-aa73-57f7d408c62d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:08.265187 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-fcf9bf11-ad77-44fa-aa73-57f7d408c62d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/77769387-968c-4184-801f-134f4cd887ed HTTP/1.1" status: 204 len: 168 time: 0.6503155 Nov 11 11:45:08.348692 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-37bf5b13-1277-49f3-b2e7-1b314616dd9b req-b34d67d8-1cda-48ff-9d7f-9cde99e64b57 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0914965 Nov 11 11:45:08.352508 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-801e698b-7573-4064-8d8a-540c1acebd03 req-2bf86bb5-25f4-46c9-abdf-2c3e0a680e29 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2081232 Nov 11 11:45:08.558528 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-801e698b-7573-4064-8d8a-540c1acebd03 req-6944256d-f695-4818-b381-a991222e9612 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1993794 Nov 11 11:45:09.712110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559a2980-9999-4572-8c58-60be363fa965 req-d024e9a3-a29a-482b-b079-c7d6a9d1fc98 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:09.713711 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-559a2980-9999-4572-8c58-60be363fa965 req-d024e9a3-a29a-482b-b079-c7d6a9d1fc98 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0988395 Nov 11 11:45:09.771558 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-559a2980-9999-4572-8c58-60be363fa965 req-31600e0a-5fa3-4c36-b3af-a9d6cb3c618e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456867 Nov 11 11:45:10.018608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5bca4bf7-7fc9-46ab-8570-93e6be82fe19 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:10.996180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2107878a-5d3f-4765-b78c-28f6ad9b3e4a req-36b9a5b8-00c8-47d1-acdf-306565efc322 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:10.998348 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2107878a-5d3f-4765-b78c-28f6ad9b3e4a req-36b9a5b8-00c8-47d1-acdf-306565efc322 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0852091 Nov 11 11:45:11.048657 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2107878a-5d3f-4765-b78c-28f6ad9b3e4a req-399328bc-d678-472b-a2b8-6ee5166bdb05 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435538 Nov 11 11:45:11.273662 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:11.836753 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-b8fabf13-bb31-4f7f-85ba-f1ede8f23869 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1099 time: 0.0771830 Nov 11 11:45:11.985975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-daadde9e-3e11-4309-b7ff-d082012055ad service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:11.987591 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-daadde9e-3e11-4309-b7ff-d082012055ad service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.1450999 Nov 11 11:45:12.107756 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-9639dbd3-f620-4d77-9d5e-2d771cd5ce3b service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=48b55264-0eab-46d7-abe8-ce455a036f49 HTTP/1.1" status: 200 len: 1001 time: 0.1129963 Nov 11 11:45:12.177777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-d2239af2-1e44-4a81-a130-768c7c219fba service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:12.179432 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-d2239af2-1e44-4a81-a130-768c7c219fba service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0658510 Nov 11 11:45:12.330312 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-b0f1ba82-6500-4d30-9135-58957cde4288 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1439900 Nov 11 11:45:12.339901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ef4169-8e0f-40af-abaa-b971083b655e req-bc520a03-931e-4308-a8f5-ef4dc1ba6616 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:12.342210 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-11ef4169-8e0f-40af-abaa-b971083b655e req-bc520a03-931e-4308-a8f5-ef4dc1ba6616 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.1220529 Nov 11 11:45:12.499620 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-11ef4169-8e0f-40af-abaa-b971083b655e req-e1e85f10-5154-4d20-bea3-fc1512b5a460 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1346610 Nov 11 11:45:12.529351 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-b9da4490-a90b-454e-bbdb-50265b6f8c53 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1857140 Nov 11 11:45:12.692199 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e531dd6-5afc-43e4-ac1d-8d6c1c69737f req-44d36928-f8ad-413a-82f8-a0ba31b339ed service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1454079 Nov 11 11:45:13.488823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:13.519281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-909073ef-d1d7-445e-91bc-4da4ab78816a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:13.947396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05dc97b-038a-4aa5-a098-07ab6f7e925b req-d40a4e48-3195-47c0-b280-c80e0297e0bd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:13.948977 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a05dc97b-038a-4aa5-a098-07ab6f7e925b req-d40a4e48-3195-47c0-b280-c80e0297e0bd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.3042738 Nov 11 11:45:14.000294 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a05dc97b-038a-4aa5-a098-07ab6f7e925b req-a1ad8652-377b-4ff9-bed0-8d3d101d2e9b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443928 Nov 11 11:45:14.633384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:15.217362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-019f9919-252e-4530-887e-4d8e9cdd5aca req-9faea012-3723-44ab-adad-cae501c2d07c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:15.219896 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-019f9919-252e-4530-887e-4d8e9cdd5aca req-9faea012-3723-44ab-adad-cae501c2d07c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 946 time: 0.0840790 Nov 11 11:45:15.269755 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-019f9919-252e-4530-887e-4d8e9cdd5aca req-17f01673-c706-4118-9844-7c47db2b78e1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432591 Nov 11 11:45:16.273099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:45:16.394784 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:16.434807 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:45:16.448423 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:45:16.494540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:16.497765 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49', 'code': 422} returned with failed status Nov 11 11:45:16.498317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:16.562654 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9975e329-1d9c-41c6-8f30-518d420eb3d1 req-a686a1aa-a01c-4984-8d37-564e756297bb service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0828576 Nov 11 11:45:16.570150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=8']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:16.580407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.580803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.581187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.581563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.581940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.582315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.582685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.583073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.583471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.583838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.584205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:16.588378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:16.939859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b7ba5d0-5209-4e61-83ce-32f337f52918 req-d072623c-14af-47a1-8846-7164faede1be tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:16.941483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3b7ba5d0-5209-4e61-83ce-32f337f52918 req-d072623c-14af-47a1-8846-7164faede1be tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0916088 Nov 11 11:45:16.995796 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3b7ba5d0-5209-4e61-83ce-32f337f52918 req-2354f174-4ade-4c53-bfb6-c08d66e8a39e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477476 Nov 11 11:45:17.044389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36816) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:17.207964 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-2b06380f-9a2b-4747-bd80-7c14469f3976 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1621861 Nov 11 11:45:17.570226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36834) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:17.757011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:17.801398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:17.805681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Usage tracker for resource:security_group_rule and tenant:a7a7cd28cf014f648cafd26e5dd38746 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:17.808821 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:17.814853 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:17.883405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:17.923408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:17.935889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d84a5149-a964-468b-9460-5e588a3533d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:17.991515 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=a7a7cd28cf014f648cafd26e5dd38746&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4200349 Nov 11 11:45:17.992581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d59083d6-1318-448a-ad3c-2ba481bd404c,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:17.994530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 36840) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:17.996235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:18.068772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ff60e541-3e07-4eb5-8dc9-0e3159f0d0a6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:18.099980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ff60e541-3e07-4eb5-8dc9-0e3159f0d0a6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:18.181803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ff60e541-3e07-4eb5-8dc9-0e3159f0d0a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:18.187908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4f94b8a1-4d96-4c59-a614-ddabbabbbfbb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:18.203901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff60e541-3e07-4eb5-8dc9-0e3159f0d0a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d59083d6-1318-448a-ad3c-2ba481bd404c,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:18.206968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ff60e541-3e07-4eb5-8dc9-0e3159f0d0a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:18.208270 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ff60e541-3e07-4eb5-8dc9-0e3159f0d0a6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:18.212562 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ff60e541-3e07-4eb5-8dc9-0e3159f0d0a6 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/d59083d6-1318-448a-ad3c-2ba481bd404c HTTP/1.1" status: 204 len: 168 time: 0.2167392 Nov 11 11:45:18.407384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f1a692-3f2d-4f04-8a80-24009d820688 req-f86414ad-4037-484c-bf54-fe3071e2ba77 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:18.409050 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d0f1a692-3f2d-4f04-8a80-24009d820688 req-f86414ad-4037-484c-bf54-fe3071e2ba77 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.2545855 Nov 11 11:45:18.469794 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d0f1a692-3f2d-4f04-8a80-24009d820688 req-6da0bb18-d9bc-404b-9a81-2c2d32151f48 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502973 Nov 11 11:45:18.814614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36852) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:18.837125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:18.872059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:18.876826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Usage tracker for resource:security_group_rule and tenant:9426e6cd602e4da6a4936df3d370bdac is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:18.879972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:18.888937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:19.067239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:19.125666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:19.139722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-eec8b2b9-ab43-47f8-a265-40a2e76f0214 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:19.183764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ac59d73-e9c1-4626-9692-a825ada0fedd,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:19.188768 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9426e6cd602e4da6a4936df3d370bdac&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3721418 Nov 11 11:45:19.189846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:19.191549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 36856) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:19.261452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-386c4b45-5c3f-494f-883e-2e0275e7f80e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:19.290688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-386c4b45-5c3f-494f-883e-2e0275e7f80e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:19.342366 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-5fe4c3cb-ccb5-44a4-8f56-e558bb6146d8 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf&tenant_id=49b88e3cf8f748be91f37e0b9caccf6d HTTP/1.1" status: 200 len: 1097 time: 0.0800912 Nov 11 11:45:19.399094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-386c4b45-5c3f-494f-883e-2e0275e7f80e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:19.404632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4a348112-8744-42ac-8f45-7ade7158c562 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:19.422221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-386c4b45-5c3f-494f-883e-2e0275e7f80e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ac59d73-e9c1-4626-9692-a825ada0fedd,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:19.425250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-386c4b45-5c3f-494f-883e-2e0275e7f80e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:19.441857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-386c4b45-5c3f-494f-883e-2e0275e7f80e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:19.445972 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-386c4b45-5c3f-494f-883e-2e0275e7f80e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8ac59d73-e9c1-4626-9692-a825ada0fedd HTTP/1.1" status: 204 len: 168 time: 0.2454362 Nov 11 11:45:19.462353 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-78e24097-7208-4175-85fc-5002c84dc1e6 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1097 time: 0.0952654 Nov 11 11:45:19.681101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-e4108ed6-3151-40a1-8877-a23ed6916dd5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:19.682555 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-e4108ed6-3151-40a1-8877-a23ed6916dd5 service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.2118859 Nov 11 11:45:20.035552 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-825bcebf-5c64-4f42-8f21-57a74959188a service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=48b55264-0eab-46d7-abe8-ce455a036f49 HTTP/1.1" status: 200 len: 999 time: 0.1231771 Nov 11 11:45:20.042020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b646a038-c513-4e4a-ac0d-8fd730095afc req-4b2ea0a0-5cf6-44a2-bfc3-0358a5e0eefd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:20.043483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b646a038-c513-4e4a-ac0d-8fd730095afc req-4b2ea0a0-5cf6-44a2-bfc3-0358a5e0eefd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.4147706 Nov 11 11:45:20.137094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-bba479ea-d5fc-47b2-9f10-7673aa571b91 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:20.138743 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-bba479ea-d5fc-47b2-9f10-7673aa571b91 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0942430 Nov 11 11:45:20.195211 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b646a038-c513-4e4a-ac0d-8fd730095afc req-b19dfe6e-c6cd-4c85-9f93-67a2850cd55f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1122861 Nov 11 11:45:20.229150 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-7f6b8108-0d67-4cae-a39d-1d180c885460 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0836875 Nov 11 11:45:20.375133 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-e630bd95-6578-4d16-b2a6-41e0a3facd3a service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1394663 Nov 11 11:45:20.528424 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-7dfbf09d-b545-4c18-b53e-31c6d3af61fc service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1463940 Nov 11 11:45:21.422595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f7d585-2a86-4fa8-a5c0-933254decdd4 req-ea88bba8-a962-4381-a06a-97d6aca6d762 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:21.423990 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-59f7d585-2a86-4fa8-a5c0-933254decdd4 req-ea88bba8-a962-4381-a06a-97d6aca6d762 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0849822 Nov 11 11:45:21.481577 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-59f7d585-2a86-4fa8-a5c0-933254decdd4 req-df28a8c8-d39f-4236-89f6-2a886bf6a0f0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507059 Nov 11 11:45:22.751353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441bb79f-be46-4eeb-9f56-24f2be593b4e req-8c797a85-51a0-44e2-8c67-d2282d4c534e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:22.753727 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-441bb79f-be46-4eeb-9f56-24f2be593b4e req-8c797a85-51a0-44e2-8c67-d2282d4c534e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0939784 Nov 11 11:45:22.805059 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-441bb79f-be46-4eeb-9f56-24f2be593b4e req-d5d66468-c924-4256-b40e-698c457deede tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444064 Nov 11 11:45:24.069082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8d7c13-82d9-4df4-95e7-7c6d850f89c9 req-525ace6d-3fcd-4508-8493-93bbe3a9df82 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:24.071725 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cf8d7c13-82d9-4df4-95e7-7c6d850f89c9 req-525ace6d-3fcd-4508-8493-93bbe3a9df82 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0874729 Nov 11 11:45:24.136368 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cf8d7c13-82d9-4df4-95e7-7c6d850f89c9 req-126ad734-f10e-4973-be2b-94cc7440344f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0572340 Nov 11 11:45:25.359399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d79a60-6619-47ac-8fa3-1348a3e98ca6 req-ecbce757-bb4c-4a4d-a0f8-4544c1d77a21 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:25.360991 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7d79a60-6619-47ac-8fa3-1348a3e98ca6 req-ecbce757-bb4c-4a4d-a0f8-4544c1d77a21 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0860825 Nov 11 11:45:25.410191 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7d79a60-6619-47ac-8fa3-1348a3e98ca6 req-355c7cf8-8cf4-438d-a1fa-a8f5eb24f0f9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427706 Nov 11 11:45:26.647556 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-536b11d4-4524-4a07-b2a5-88088001b6e7 req-37140a4d-e8d6-46e1-86fe-c1978f0c680a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:26.649323 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-536b11d4-4524-4a07-b2a5-88088001b6e7 req-37140a4d-e8d6-46e1-86fe-c1978f0c680a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0848465 Nov 11 11:45:26.701128 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-536b11d4-4524-4a07-b2a5-88088001b6e7 req-82f7f3f2-d6d7-4bec-8249-042e1e4c05df tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457988 Nov 11 11:45:27.930080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c356d7d5-c4d4-4748-9b16-4ad105d76a34 req-740be14a-2082-4679-b5d4-dbb690825f83 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:27.931656 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c356d7d5-c4d4-4748-9b16-4ad105d76a34 req-740be14a-2082-4679-b5d4-dbb690825f83 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0856903 Nov 11 11:45:27.981043 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c356d7d5-c4d4-4748-9b16-4ad105d76a34 req-e16b2386-96eb-49af-943e-b4ef282d013f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433080 Nov 11 11:45:29.214456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f93eb17-dec2-4039-85f1-9987a0e928e1 req-838cc702-6687-4a5c-83ec-957724554c06 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:29.216164 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4f93eb17-dec2-4039-85f1-9987a0e928e1 req-838cc702-6687-4a5c-83ec-957724554c06 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0865457 Nov 11 11:45:29.268937 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4f93eb17-dec2-4039-85f1-9987a0e928e1 req-ea98c09a-5f2a-40cc-9553-da489baf3700 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453813 Nov 11 11:45:30.499438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676336f2-b0bb-4643-8189-ec92f9a4dbac req-29738331-c4da-45dc-96e4-894bc2d591c2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:30.501049 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-676336f2-b0bb-4643-8189-ec92f9a4dbac req-29738331-c4da-45dc-96e4-894bc2d591c2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0870147 Nov 11 11:45:30.550962 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-676336f2-b0bb-4643-8189-ec92f9a4dbac req-20daa51f-c5e8-4989-a096-1ce9358c9952 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436821 Nov 11 11:45:31.778812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e035c39-d01b-4474-9fdb-77977e3295ba req-da8644f6-4b2b-4ed6-9c6d-d7c2df1d13ab tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:31.780628 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e035c39-d01b-4474-9fdb-77977e3295ba req-da8644f6-4b2b-4ed6-9c6d-d7c2df1d13ab tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0891762 Nov 11 11:45:31.832739 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e035c39-d01b-4474-9fdb-77977e3295ba req-ce3e677a-1bf7-4865-a4a1-ffef59ff8abd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455098 Nov 11 11:45:33.289133 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70319ec8-2e9a-4924-aedc-8f4f194e45a6 req-7e6aa742-1c10-4c12-94d5-ceebcda4bc05 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:33.290663 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70319ec8-2e9a-4924-aedc-8f4f194e45a6 req-7e6aa742-1c10-4c12-94d5-ceebcda4bc05 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0841093 Nov 11 11:45:33.340706 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70319ec8-2e9a-4924-aedc-8f4f194e45a6 req-87f9f3e5-dbcb-4d42-a8a2-de85c7366573 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431764 Nov 11 11:45:34.557264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:34.596696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418c6bce-d19e-4e36-8ecb-14ab24b207da req-fb04ae31-963f-4332-8e02-96b95d2005e2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:34.598481 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-418c6bce-d19e-4e36-8ecb-14ab24b207da req-fb04ae31-963f-4332-8e02-96b95d2005e2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.1117370 Nov 11 11:45:34.651607 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-418c6bce-d19e-4e36-8ecb-14ab24b207da req-1faed10f-19dc-4539-a09b-6808b483e91b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455892 Nov 11 11:45:35.889589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e2438f5-17a3-4c2f-9838-9e1759646227 req-045a13d3-da16-4069-a012-193fe5d50f40 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:35.897979 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e2438f5-17a3-4c2f-9838-9e1759646227 req-045a13d3-da16-4069-a012-193fe5d50f40 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.1015625 Nov 11 11:45:35.949472 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e2438f5-17a3-4c2f-9838-9e1759646227 req-40c5f106-a160-4be4-b8f5-81f20168a614 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505989 Nov 11 11:45:36.180255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 37018) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:36.357781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:36.392013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:36.395741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Usage tracker for resource:security_group_rule and tenant:bf8e76b4314942b49fc8fa0db6f147f1 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:36.398887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:36.405078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:36.481352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:36.571362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:45:37.179089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e85697e9-70cb-44f4-90a5-374e5f384e49 req-bbb2ff01-c1e3-493d-bdf5-40c1357fd4da tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:37.180702 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e85697e9-70cb-44f4-90a5-374e5f384e49 req-bbb2ff01-c1e3-493d-bdf5-40c1357fd4da tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0850937 Nov 11 11:45:37.237994 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e85697e9-70cb-44f4-90a5-374e5f384e49 req-946fb7b3-d22f-4b92-8b56-ec0fe6ebf4ce tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473812 Nov 11 11:45:37.465010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:37.472809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3b53cfa5-6e95-48cd-8947-32ed4e8d0faf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:37.512769 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba7c2ca3-aed3-4e7c-89f1-648a847c4000,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:37.527083 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bf8e76b4314942b49fc8fa0db6f147f1&name=default HTTP/1.1" status: 200 len: 2647 time: 1.3455327 Nov 11 11:45:37.529783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.529783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.530031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37026) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:37.530198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.530627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.531030 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.531431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.531818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.532208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.532595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.532983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.533367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:37.537768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:37.601380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-140b6551-007d-4643-ac09-56cbfe9e09ab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:37.629043 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-140b6551-007d-4643-ac09-56cbfe9e09ab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:37.701119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-140b6551-007d-4643-ac09-56cbfe9e09ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:37.706269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-53e06130-9f66-4062-82a6-703d1cddf0e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:37.718900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-140b6551-007d-4643-ac09-56cbfe9e09ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba7c2ca3-aed3-4e7c-89f1-648a847c4000,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:37.722040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-140b6551-007d-4643-ac09-56cbfe9e09ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:37.724306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-140b6551-007d-4643-ac09-56cbfe9e09ab admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:37.725456 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-140b6551-007d-4643-ac09-56cbfe9e09ab admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ba7c2ca3-aed3-4e7c-89f1-648a847c4000 HTTP/1.1" status: 204 len: 168 time: 0.1945593 Nov 11 11:45:38.230341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37034) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:38.250526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:38.282741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:38.286857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Usage tracker for resource:security_group_rule and tenant:2748b087fb0b4129bc5006046cf11fcb is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:38.289898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:38.295870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:38.365140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:38.396404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:38.404257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fcf9bf11-ad77-44fa-aa73-57f7d408c62d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:38.450488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce3616ff-5c08-4536-a415-b281ddb9eb16,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:38.453449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78b41794-2672-4682-bad1-e2b7fe30484d req-74ad3b2e-df32-435d-a41b-78497b49b8bf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:38.454251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:38.454998 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-78b41794-2672-4682-bad1-e2b7fe30484d req-74ad3b2e-df32-435d-a41b-78497b49b8bf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0833809 Nov 11 11:45:38.456583 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2748b087fb0b4129bc5006046cf11fcb&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2251067 Nov 11 11:45:38.459404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37040) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:38.506747 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-78b41794-2672-4682-bad1-e2b7fe30484d req-bbe972df-56aa-4378-be3f-56858561b4a9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447183 Nov 11 11:45:38.525493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-458a0185-ef19-4c47-a700-19626325182c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:38.553433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-458a0185-ef19-4c47-a700-19626325182c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:38.626606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-458a0185-ef19-4c47-a700-19626325182c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:38.631771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8b13b7bf-a6a2-4dde-aacc-14b4e0323ff3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:38.644730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-458a0185-ef19-4c47-a700-19626325182c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce3616ff-5c08-4536-a415-b281ddb9eb16,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:38.647887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-458a0185-ef19-4c47-a700-19626325182c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:38.649907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-458a0185-ef19-4c47-a700-19626325182c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:38.651386 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-458a0185-ef19-4c47-a700-19626325182c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ce3616ff-5c08-4536-a415-b281ddb9eb16 HTTP/1.1" status: 204 len: 168 time: 0.1905069 Nov 11 11:45:39.743343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517ab042-0b19-4421-8c5b-819403fa0141 req-b09e7ee3-adfd-40da-9f33-68792ecba24c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:39.744978 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-517ab042-0b19-4421-8c5b-819403fa0141 req-b09e7ee3-adfd-40da-9f33-68792ecba24c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0984585 Nov 11 11:45:39.794265 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-517ab042-0b19-4421-8c5b-819403fa0141 req-47bae952-bd29-4516-8670-e65de59d7e3c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429094 Nov 11 11:45:40.008142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9f397d95-2431-4e88-89cd-6b319331947b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:41.014243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ae6b0ed-e36b-4cb3-bba5-d12ac5d3b7f5 req-0cde512a-b827-471c-8c6c-9d6bcc5c1a04 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:41.015887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6ae6b0ed-e36b-4cb3-bba5-d12ac5d3b7f5 req-0cde512a-b827-471c-8c6c-9d6bcc5c1a04 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0836577 Nov 11 11:45:41.069950 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6ae6b0ed-e36b-4cb3-bba5-d12ac5d3b7f5 req-37c4b203-8c1d-4545-b8b9-0d56bdb9c4b9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475235 Nov 11 11:45:41.261210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:42.294882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75513d2c-4190-495e-bc26-7c942f440f45 req-f0950fe5-6adb-4492-a53a-ae30d3ed31ba tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:42.297030 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75513d2c-4190-495e-bc26-7c942f440f45 req-f0950fe5-6adb-4492-a53a-ae30d3ed31ba tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0879004 Nov 11 11:45:42.346872 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-75513d2c-4190-495e-bc26-7c942f440f45 req-b2ac8fe6-3776-4b7d-8ad6-db81e29a1361 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435729 Nov 11 11:45:42.542082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37122) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:42.699186 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:42.731457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:42.736043 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Usage tracker for resource:security_group_rule and tenant:d25de9db9f2b472bae08a8eb6d9190a6 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:42.738896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:42.744805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:42.811883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:42.855234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:42.863365 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-48be5493-bd76-4595-b14e-86b9e19f99e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:42.910147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c98db61-b165-4686-8f0d-1baa868b70d7,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:42.916175 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d25de9db9f2b472bae08a8eb6d9190a6&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3729968 Nov 11 11:45:42.919082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 37128) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:42.922000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.922419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.922827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.923261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.923668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.924070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.924471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.924868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.925261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.926085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.926085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:45:42.930300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:42.987649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d6c353e1-0936-4023-81e7-be924099311a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.014709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d6c353e1-0936-4023-81e7-be924099311a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.104697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d6c353e1-0936-4023-81e7-be924099311a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.109833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3a354688-ecde-413d-bd1b-c132b55a6fbc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:43.122440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c353e1-0936-4023-81e7-be924099311a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c98db61-b165-4686-8f0d-1baa868b70d7,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:43.126178 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d6c353e1-0936-4023-81e7-be924099311a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:43.131695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d6c353e1-0936-4023-81e7-be924099311a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.132910 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d6c353e1-0936-4023-81e7-be924099311a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1c98db61-b165-4686-8f0d-1baa868b70d7 HTTP/1.1" status: 204 len: 168 time: 0.2127416 Nov 11 11:45:43.525870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4d048013-28d3-4a07-83f9-d81d058cffcb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.545560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.573414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21fe68b6-3ce5-49dc-abf1-a14713c48bc4 req-cc7700e1-3a26-498a-bd45-eb8650488950 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:43.575049 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-21fe68b6-3ce5-49dc-abf1-a14713c48bc4 req-cc7700e1-3a26-498a-bd45-eb8650488950 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0857244 Nov 11 11:45:43.625234 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-21fe68b6-3ce5-49dc-abf1-a14713c48bc4 req-ad31d3c8-9594-47bf-977c-d9162b3b23a0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432315 Nov 11 11:45:43.655131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 37138) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:43.675110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.706928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:43.710910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Usage tracker for resource:security_group_rule and tenant:b3c64788630b43fcb6c708b729b26820 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:43.713823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:43.720068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:43.789808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.826757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.834285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:43.879983 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b3c64788630b43fcb6c708b729b26820&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2235186 Nov 11 11:45:43.880682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=670f0d6d-d131-4d79-b6e8-40548a42b63a,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:43.882681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37142) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:43.883866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:43.947125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2fcc4a8-8c93-4670-aada-a645f120d812 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:43.974644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2fcc4a8-8c93-4670-aada-a645f120d812 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:44.049674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2fcc4a8-8c93-4670-aada-a645f120d812 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:44.054803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dfcfeceb-fb09-4bf9-9bdd-d5e0082f763c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:44.067463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2fcc4a8-8c93-4670-aada-a645f120d812 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=670f0d6d-d131-4d79-b6e8-40548a42b63a,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:44.069846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c2fcc4a8-8c93-4670-aada-a645f120d812 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:44.077072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2fcc4a8-8c93-4670-aada-a645f120d812 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:44.078442 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c2fcc4a8-8c93-4670-aada-a645f120d812 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/670f0d6d-d131-4d79-b6e8-40548a42b63a HTTP/1.1" status: 204 len: 168 time: 0.1944854 Nov 11 11:45:44.632304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:44.849067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb341e8-1b6f-4db2-9f9e-09408af62e28 req-2dd60b56-80b6-4a2b-ac06-23abb4fffc5e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:44.850729 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dfb341e8-1b6f-4db2-9f9e-09408af62e28 req-2dd60b56-80b6-4a2b-ac06-23abb4fffc5e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0853467 Nov 11 11:45:44.900465 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dfb341e8-1b6f-4db2-9f9e-09408af62e28 req-a773cb0b-f5eb-4d9f-8767-dab491c4b51e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435135 Nov 11 11:45:46.121831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6acd2a29-00cb-44be-b925-069502026a4c req-f2d362a2-1746-449f-b791-30a7e149017e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:46.123408 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6acd2a29-00cb-44be-b925-069502026a4c req-f2d362a2-1746-449f-b791-30a7e149017e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0862737 Nov 11 11:45:46.172928 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6acd2a29-00cb-44be-b925-069502026a4c req-09a35876-a8e3-47d4-890d-af8f5eddd50a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426857 Nov 11 11:45:47.397339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab73b7ac-f723-448d-a743-5f4b29de0470 req-e99b87e8-11a7-49dc-9894-6a33669d93ab tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:47.398915 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ab73b7ac-f723-448d-a743-5f4b29de0470 req-e99b87e8-11a7-49dc-9894-6a33669d93ab tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0883970 Nov 11 11:45:47.458113 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ab73b7ac-f723-448d-a743-5f4b29de0470 req-f2bfc3f8-dafa-449a-a57a-b181387aebea tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502551 Nov 11 11:45:48.495018 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:45:48.638788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:45:48.657016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '48b55264-0eab-46d7-abe8-ce455a036f49', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'port_id': '48b55264-0eab-46d7-abe8-ce455a036f49', 'mac_address': 'fa:16:3e:18:a5:54', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1022, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:45:48.680678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc79594c-a69e-479d-96d9-9ab8839e9d68 req-1a40a8a7-1aa1-480a-b3c7-9be3cfbd58b2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:48.682274 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc79594c-a69e-479d-96d9-9ab8839e9d68 req-1a40a8a7-1aa1-480a-b3c7-9be3cfbd58b2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 944 time: 0.0827429 Nov 11 11:45:48.712046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:48.730905 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 48b55264-0eab-46d7-abe8-ce455a036f49 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:45:48.731824 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc79594c-a69e-479d-96d9-9ab8839e9d68 req-b76636f7-a7b5-4d50-a28d-0e69b58af489 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427749 Nov 11 11:45:48.746944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:45:48.773570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:48.775506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:48.841204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=9']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:48.845012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:49.197983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['48b55264-0eab-46d7-abe8-ce455a036f49'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:45:49.958453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49f1655-098a-484a-aaab-265e42731e33 req-01ae0d79-87bb-4cf0-a513-879e3eebe830 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:49.960126 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b49f1655-098a-484a-aaab-265e42731e33 req-01ae0d79-87bb-4cf0-a513-879e3eebe830 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 945 time: 0.0921454 Nov 11 11:45:49.977140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37220) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:50.011847 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b49f1655-098a-484a-aaab-265e42731e33 req-236255d7-3a32-443e-b4f9-0c001f7c7386 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453899 Nov 11 11:45:50.136543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.169737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:45:50.174350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Usage tracker for resource:security_group_rule and tenant:dd9f8ad0fae74f1fa094bacfaff3d5c3 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:45:50.177281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:45:50.183205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:45:50.254671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.335517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.344465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-12c98356-cb9a-4884-abac-f6a6a86228b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:50.386409 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3dac7ecc-92d1-436e-ab3f-a51fcfe52474,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:50.390359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:50.394204 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=dd9f8ad0fae74f1fa094bacfaff3d5c3&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4159021 Nov 11 11:45:50.397049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37226) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:45:50.460066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-660789e4-cef9-47e6-8371-031188a4ced6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.487452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-660789e4-cef9-47e6-8371-031188a4ced6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.490686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:45:50.569682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-660789e4-cef9-47e6-8371-031188a4ced6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.570576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 48b55264-0eab-46d7-abe8-ce455a036f49 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:45:50.571059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.575562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4effe0bf-9b0d-4378-8cb9-c4bd54f75e5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:50.589394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660789e4-cef9-47e6-8371-031188a4ced6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3dac7ecc-92d1-436e-ab3f-a51fcfe52474,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:50.592696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-660789e4-cef9-47e6-8371-031188a4ced6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:50.595928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-660789e4-cef9-47e6-8371-031188a4ced6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.597587 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-660789e4-cef9-47e6-8371-031188a4ced6 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/3dac7ecc-92d1-436e-ab3f-a51fcfe52474 HTTP/1.1" status: 204 len: 168 time: 0.1993039 Nov 11 11:45:50.704300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.732499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:45:50.742970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:45:50.769796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:45:50.773216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-91706e65-58d0-4116-86f7-489f90496b8e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:45:50.817338 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49', 'code': 200} Nov 11 11:45:50.859776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=10']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:45:50.863023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:45:51.257397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1949d010-21fc-422f-9f69-65ae0b5f192e req-cb3d879a-04b3-4140-8ee3-a69d32d2fb36 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:51.259267 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1949d010-21fc-422f-9f69-65ae0b5f192e req-cb3d879a-04b3-4140-8ee3-a69d32d2fb36 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 947 time: 0.0911841 Nov 11 11:45:51.311348 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1949d010-21fc-422f-9f69-65ae0b5f192e req-7c3a3f32-1791-4360-86af-d1d02083fa48 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450399 Nov 11 11:45:51.798240 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3db0adf-6144-4528-b375-d4114668876c req-ba262382-599a-4e4d-9e22-358b31a235d6 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1100 time: 0.2301443 Nov 11 11:45:51.849477 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3db0adf-6144-4528-b375-d4114668876c req-918ba97c-81c6-4b3d-b12f-1dde1a957e02 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449591 Nov 11 11:45:52.549957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b1ec28-8fa3-4226-9d39-e0a0acbf26d4 req-c5577ec9-499f-41e5-b7f9-26baa6dc1eec tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:52.551591 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c2b1ec28-8fa3-4226-9d39-e0a0acbf26d4 req-c5577ec9-499f-41e5-b7f9-26baa6dc1eec tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 947 time: 0.0846436 Nov 11 11:45:52.604035 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c2b1ec28-8fa3-4226-9d39-e0a0acbf26d4 req-839bae84-ad28-4591-8052-bcc2eb945a40 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464323 Nov 11 11:45:53.837263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52b2b5fa-ea96-4000-ba77-9f62db8226ea req-658a18d1-447c-46cc-b7d2-cde43b5e6741 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:53.838801 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-52b2b5fa-ea96-4000-ba77-9f62db8226ea req-658a18d1-447c-46cc-b7d2-cde43b5e6741 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 947 time: 0.0926023 Nov 11 11:45:53.890206 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-52b2b5fa-ea96-4000-ba77-9f62db8226ea req-e76bf6c2-a567-46da-8116-1996c4fb7125 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440161 Nov 11 11:45:55.127048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6a90a3-6106-4bc9-8db6-4c40859b75b4 req-7ffd1957-9ee6-4b36-a18e-cdfae1d57d04 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:45:55.128711 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fd6a90a3-6106-4bc9-8db6-4c40859b75b4 req-7ffd1957-9ee6-4b36-a18e-cdfae1d57d04 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 947 time: 0.0941651 Nov 11 11:45:55.180771 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fd6a90a3-6106-4bc9-8db6-4c40859b75b4 req-659da72e-14e0-4cb3-9cf4-207b363928fd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449815 Nov 11 11:46:04.535365 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:08.579703 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-6f3c9d65-0443-4bd1-9b80-3040f20681fb service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0782328 Nov 11 11:46:08.732903 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-76db3b78-24ba-43c0-817c-2e64f1b4b40e service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 1099 time: 0.0778716 Nov 11 11:46:09.106403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-6594ccd4-b68c-4424-a992-90476e28374c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:09.108181 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-6594ccd4-b68c-4424-a992-90476e28374c service neutron] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 913 time: 0.3544037 Nov 11 11:46:09.219859 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-6ef0a50e-04f3-4139-9424-0915ec2b61d2 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c HTTP/1.1" status: 200 len: 1001 time: 0.1045299 Nov 11 11:46:09.288230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-1a2108aa-f03e-4568-bcbc-a585b7e25dfa service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:09.289833 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-1a2108aa-f03e-4568-bcbc-a585b7e25dfa service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.0635359 Nov 11 11:46:09.374162 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-f0746a29-99ef-4c85-9d13-38e94a4a955d service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0775607 Nov 11 11:46:09.529092 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-4dccbe35-2a1b-45a8-8f37-c7b07ae782da service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1474822 Nov 11 11:46:09.682016 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e90e458-5a97-45d0-ad32-3a2f1c1f0249 req-0904e3fe-ae6b-4c6c-951c-ad68de252d32 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1435888 Nov 11 11:46:10.009003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2fe264df-aebb-4997-8529-b29cc8a60824 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:11.266845 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:13.507001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:13.569111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0ad1bdc3-2fd1-48ab-bc2e-dc16d3ed9596 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:13.573892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:46:14.660087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:16.874911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb1aa7c-d5e7-4c98-9655-658ef3a56d1c req-e9c63171-1e27-47c4-8c01-102854b8d1ee tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:16.877159 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fdb1aa7c-d5e7-4c98-9655-658ef3a56d1c req-e9c63171-1e27-47c4-8c01-102854b8d1ee tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0893114 Nov 11 11:46:16.927517 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fdb1aa7c-d5e7-4c98-9655-658ef3a56d1c req-186dcc1c-0159-4ff1-a5f7-a5a4df58dc94 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439703 Nov 11 11:46:18.143364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51ecce0-0a29-4b3b-a8db-b16c1569f5aa req-5582f9e7-08cb-403f-9d2f-ef83bc747f66 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:18.144950 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a51ecce0-0a29-4b3b-a8db-b16c1569f5aa req-5582f9e7-08cb-403f-9d2f-ef83bc747f66 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0865104 Nov 11 11:46:18.202736 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a51ecce0-0a29-4b3b-a8db-b16c1569f5aa req-7bc0648f-a869-44d3-83ee-7fbdc37815f8 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513251 Nov 11 11:46:19.414536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d74d0e9-b5b0-4b92-865a-3b3b863ae4b5 req-64bfd1d7-54f0-4a2a-9330-a8fcf68a282d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:19.416146 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0d74d0e9-b5b0-4b92-865a-3b3b863ae4b5 req-64bfd1d7-54f0-4a2a-9330-a8fcf68a282d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0836413 Nov 11 11:46:19.466822 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0d74d0e9-b5b0-4b92-865a-3b3b863ae4b5 req-5c0e40e1-3c70-4346-9fee-7b20e3095c72 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445459 Nov 11 11:46:20.694565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0573db06-a858-45d6-8594-731daaeaf409 req-5294585a-e6e1-4905-8f45-b7125b128f15 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:20.696174 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0573db06-a858-45d6-8594-731daaeaf409 req-5294585a-e6e1-4905-8f45-b7125b128f15 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0913069 Nov 11 11:46:20.746074 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0573db06-a858-45d6-8594-731daaeaf409 req-cbdd031b-ef4c-4603-ac7a-85adcf9f4c80 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437689 Nov 11 11:46:21.955595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e6d8fe-5cbb-4482-88f7-eb22ed16944e req-dc01bcbb-6f6c-442e-b05b-ec4e57064d4f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:21.957233 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-95e6d8fe-5cbb-4482-88f7-eb22ed16944e req-dc01bcbb-6f6c-442e-b05b-ec4e57064d4f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0850697 Nov 11 11:46:22.012955 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-95e6d8fe-5cbb-4482-88f7-eb22ed16944e req-9f337fa5-c566-4ceb-9e9a-7d71fb80a636 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494137 Nov 11 11:46:23.252643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a560c8a0-294a-4f1d-acc6-abf9feb2db30 req-6e1a4e7b-104d-492f-8e9e-8348b67f691c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:23.255702 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a560c8a0-294a-4f1d-acc6-abf9feb2db30 req-6e1a4e7b-104d-492f-8e9e-8348b67f691c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1132679 Nov 11 11:46:23.314276 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a560c8a0-294a-4f1d-acc6-abf9feb2db30 req-1067cd54-2a05-4521-9f5a-7104b2e437c3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517633 Nov 11 11:46:24.529930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a470054f-fe86-4488-8929-aef3b16e3a5a req-2dde19da-087a-44ac-8d35-9253426c26b8 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:24.531560 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a470054f-fe86-4488-8929-aef3b16e3a5a req-2dde19da-087a-44ac-8d35-9253426c26b8 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0855587 Nov 11 11:46:24.584319 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a470054f-fe86-4488-8929-aef3b16e3a5a req-e58ff3c0-6405-4125-974f-4013566453e9 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460107 Nov 11 11:46:25.791419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acbff646-5cc4-421a-abb6-e5e60d45ae9a req-9a7c43f2-a6bf-4976-a4fd-845099d31718 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:25.792950 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-acbff646-5cc4-421a-abb6-e5e60d45ae9a req-9a7c43f2-a6bf-4976-a4fd-845099d31718 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0851943 Nov 11 11:46:25.842165 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-acbff646-5cc4-421a-abb6-e5e60d45ae9a req-49d572b3-b3c8-4f7b-98e2-d4d5afd3309e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430558 Nov 11 11:46:27.053173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26eb860e-b8bb-4a5f-b400-57b9b5409093 req-6225c936-3931-40d5-8c63-dfe7fdb6fc2b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:27.054818 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-26eb860e-b8bb-4a5f-b400-57b9b5409093 req-6225c936-3931-40d5-8c63-dfe7fdb6fc2b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0848212 Nov 11 11:46:27.109897 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-26eb860e-b8bb-4a5f-b400-57b9b5409093 req-00c30506-5c0c-4132-9d66-49ca0b9baa43 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486739 Nov 11 11:46:28.324510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b4f98d-ae86-478a-a803-42798a505378 req-7e8f09fa-02e0-4d90-8b7e-d8fac2e65abe tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:28.326176 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f0b4f98d-ae86-478a-a803-42798a505378 req-7e8f09fa-02e0-4d90-8b7e-d8fac2e65abe tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0937247 Nov 11 11:46:28.377213 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f0b4f98d-ae86-478a-a803-42798a505378 req-ede1f4c4-303b-41e4-9aae-7138ea5d0b4f tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444708 Nov 11 11:46:28.875561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f010da60-a66d-40e5-adb4-8ce59d995fcc req-0d4f5af6-f6c8-4f87-8c1a-9aaa99957de7 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:28.877182 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f010da60-a66d-40e5-adb4-8ce59d995fcc req-0d4f5af6-f6c8-4f87-8c1a-9aaa99957de7 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1404686 Nov 11 11:46:28.944104 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-8f1c08a3-1774-4444-87d3-94e817899524 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 1099 time: 0.1230462 Nov 11 11:46:28.948522 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f010da60-a66d-40e5-adb4-8ce59d995fcc req-536eef14-8daa-4d6e-82cf-e9599b741925 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0636191 Nov 11 11:46:29.099751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-3d9678b7-d70c-4ec9-ab64-656fe7744b38 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:29.101252 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-3d9678b7-d70c-4ec9-ab64-656fe7744b38 service neutron] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 913 time: 0.1511497 Nov 11 11:46:29.210030 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-8ee48889-4ec8-42c6-b6a3-71f04ecd3148 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c HTTP/1.1" status: 200 len: 1001 time: 0.1023362 Nov 11 11:46:29.277727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-05215be9-6b89-49d5-9dad-b16f0c1b4836 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:29.279301 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-05215be9-6b89-49d5-9dad-b16f0c1b4836 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.0630658 Nov 11 11:46:29.365784 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-0460026b-3866-41ae-8d7f-ce194af59f32 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0790942 Nov 11 11:46:29.510901 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-6a32f7fe-cfe0-42c5-a3f4-a972d903bb92 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1386533 Nov 11 11:46:29.654873 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4e647821-7b0f-4305-b7a8-ee87356be8a4 req-6b33ceed-8c3a-49fd-9f8c-73afaa164e3e service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1374493 Nov 11 11:46:30.160651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db176b3-e993-4778-9b2a-9453e9939bb1 req-5846fdc2-d3b4-411c-af87-045b49edb41b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:30.162329 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4db176b3-e993-4778-9b2a-9453e9939bb1 req-5846fdc2-d3b4-411c-af87-045b49edb41b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0831711 Nov 11 11:46:30.210392 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4db176b3-e993-4778-9b2a-9453e9939bb1 req-3a75e942-2a0f-405d-8cdc-873da9e6e61b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419693 Nov 11 11:46:31.425555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3887b7c4-0980-4389-ba85-b82d89680733 req-6862f336-475f-4c51-b6de-3a8a45f7a209 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:31.427176 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3887b7c4-0980-4389-ba85-b82d89680733 req-6862f336-475f-4c51-b6de-3a8a45f7a209 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.0861275 Nov 11 11:46:31.477635 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3887b7c4-0980-4389-ba85-b82d89680733 req-ef2ad3ba-dabb-4ee2-8fb1-6a71854d4087 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436096 Nov 11 11:46:34.586320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:40.008858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7fcbed6e-c169-44a4-ac77-c2f4ad2a3033 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:41.266196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:42.197033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 37604) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:46:42.350435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:42.383461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:46:42.387458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Usage tracker for resource:security_group_rule and tenant:2c0f9f5da0534513b7081546cf45d4ad is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:46:42.390355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:46:42.396310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:46:42.462676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:42.545914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:42.554768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-25c467f1-b49b-46e3-81ec-a1a081ca20ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:46:42.601146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf64a0a8-280f-4040-930c-db272c625a00,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:46:42.605697 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2c0f9f5da0534513b7081546cf45d4ad&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4076014 Nov 11 11:46:42.608681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37610) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:46:42.613400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.613779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.614177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.614571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.614961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.615391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.615780 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.616168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.616552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.616933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.617313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:46:42.621431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:46:42.677329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-39959b56-665c-4d41-9a0b-275f0140394a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:42.706102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-39959b56-665c-4d41-9a0b-275f0140394a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:42.785526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-39959b56-665c-4d41-9a0b-275f0140394a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:42.790522 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-91028a23-e750-4805-995b-d4c642fd53c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:46:42.801321 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39959b56-665c-4d41-9a0b-275f0140394a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf64a0a8-280f-4040-930c-db272c625a00,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:46:42.806246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-39959b56-665c-4d41-9a0b-275f0140394a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:46:42.808270 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-39959b56-665c-4d41-9a0b-275f0140394a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:42.809499 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-39959b56-665c-4d41-9a0b-275f0140394a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/cf64a0a8-280f-4040-930c-db272c625a00 HTTP/1.1" status: 204 len: 168 time: 0.1997542 Nov 11 11:46:43.483019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-046acea9-224c-47e8-9642-26cce5de64f5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:43.517305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:44.637313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:50.576319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:46:54.466465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9491448-7ff7-4e82-bd4f-14bea59519e8 req-cdd961b4-5bbc-482f-93c1-7c32d6d99007 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:54.468158 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f9491448-7ff7-4e82-bd4f-14bea59519e8 req-cdd961b4-5bbc-482f-93c1-7c32d6d99007 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 945 time: 0.0848303 Nov 11 11:46:54.521095 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f9491448-7ff7-4e82-bd4f-14bea59519e8 req-3e0e3f97-fa45-42c8-9dc6-b57ed846150b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448217 Nov 11 11:46:55.741482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8181d79d-7764-471d-b6aa-8f7df53d3265 req-7fd370c1-ae6e-4345-b05e-ae1518c0bc8b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:55.743093 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8181d79d-7764-471d-b6aa-8f7df53d3265 req-7fd370c1-ae6e-4345-b05e-ae1518c0bc8b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 945 time: 0.0876458 Nov 11 11:46:55.794897 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8181d79d-7764-471d-b6aa-8f7df53d3265 req-2a6b10bd-3169-41b2-a707-83c90c2fb0e4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453353 Nov 11 11:46:56.278442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-e9d5deda-7cd5-4bc7-b4ad-7e6492c98172 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:56.280171 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-e9d5deda-7cd5-4bc7-b4ad-7e6492c98172 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 945 time: 0.0899858 Nov 11 11:46:56.359656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Deleting port 91111d35-9f12-490d-be7e-18a93e7ee046 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:46:56.360044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:56.618815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] For port 91111d35-9f12-490d-be7e-18a93e7ee046, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=91111d35-9f12-490d-be7e-18a93e7ee046,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:46:56.619256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:56.936617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:56.944499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:56.944499 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Floating IP b5b43a38-2aac-48cf-8d33-e058b0d90c9b disassociated. External IP: 172.27.3.136, port: 91111d35-9f12-490d-be7e-18a93e7ee046. Nov 11 11:46:56.944499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Calling delete_port for 91111d35-9f12-490d-be7e-18a93e7ee046 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:46:57.337016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4f9355-cc7a-4ba4-94b3-12fc0ef5abdf req-e5e7166e-aa5f-4786-82c9-993cc510c1d4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:46:57.338607 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b4f9355-cc7a-4ba4-94b3-12fc0ef5abdf req-e5e7166e-aa5f-4786-82c9-993cc510c1d4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 945 time: 0.4049225 Nov 11 11:46:57.404121 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b4f9355-cc7a-4ba4-94b3-12fc0ef5abdf req-7b2c822b-517e-47ac-9f7c-fc8db1e0cd07 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0582197 Nov 11 11:46:57.425692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:57.434829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f53017bb-9777-4d22-870a-f51f75d17038 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:46:57.480520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event deleted for resources: {'Port': ['ID=91111d35-9f12-490d-be7e-18a93e7ee046,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:46:57.484957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:46:57.707010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Router e7a84a32-cf44-4d0e-908d-7569d000b45d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:46:57.913398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:46:57.924357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:46:57.937635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:46:57.938312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:46:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:46:57.989276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] No DVR routers for this DVR port 91111d35-9f12-490d-be7e-18a93e7ee046 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:46:57.992166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:46:57.995311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'name': 'network-vif-deleted', 'tag': '91111d35-9f12-490d-be7e-18a93e7ee046'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:46:58.071971 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3e63b21b-370d-4c26-ad25-d1acb58a9775 req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "DELETE /v2.0/ports/91111d35-9f12-490d-be7e-18a93e7ee046 HTTP/1.1" status: 204 len: 173 time: 1.7858279 Nov 11 11:46:58.146813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:46:58.308055 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7572149f-eef0-4abc-944c-f17bd8e6241f', 'name': 'network-vif-deleted', 'tag': '91111d35-9f12-490d-be7e-18a93e7ee046', 'status': 'completed', 'code': 200} Nov 11 11:46:58.593026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-8136e9b2-50de-4fe9-abd7-0e0011bc82dc req-ed26b4c7-0959-414a-b0a0-5221d2a5cf3d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Synchronizing usage tracker for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:46:58.636464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-8136e9b2-50de-4fe9-abd7-0e0011bc82dc req-ed26b4c7-0959-414a-b0a0-5221d2a5cf3d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Unset dirty status for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:46:58.637783 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8136e9b2-50de-4fe9-abd7-0e0011bc82dc req-ed26b4c7-0959-414a-b0a0-5221d2a5cf3d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=7572149f-eef0-4abc-944c-f17bd8e6241f HTTP/1.1" status: 200 len: 210 time: 0.0937781 Nov 11 11:46:58.641921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:46:58.646487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:46:58.658716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:46:58.659444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:46:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:46:58.849019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:46:59.176953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:46:59.181179 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bd1588b-b8fa-4d7a-95b4-0a2ef693e70d None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:46:59.669482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-226ca94f-26c7-4a8c-92aa-b90bb1170359 None None] New status for floating IP b5b43a38-2aac-48cf-8d33-e058b0d90c9b: DOWN {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:47:00.109983 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-30691fc0-1fa8-49ab-9792-102da838f024 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2053754159&fields=id&tenant_id=1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 267 time: 0.0425949 Nov 11 11:47:00.275272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-1960acd5-0025-4701-8ad4-34f301b7d149 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:00.276831 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-1960acd5-0025-4701-8ad4-34f301b7d149 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 812 time: 0.1592832 Nov 11 11:47:00.293643 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-877959ab-3c32-4208-a162-a7c0ac51572b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/quotas/1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 375 time: 0.0110166 Nov 11 11:47:00.385409 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-56f3f612-446c-4825-8351-8b56f2a30cba tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0865157 Nov 11 11:47:00.669321 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-e3624689-6204-476e-be04-c83199505004 service neutron] 10.222.0.11 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2716448 Nov 11 11:47:00.811129 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-039fb6dd-6397-4f0e-a8e9-37367b60518d service neutron] 10.222.0.11 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1348078 Nov 11 11:47:00.850518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 91111d35-9f12-490d-be7e-18a93e7ee046 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:47:00.884531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 91111d35-9f12-490d-be7e-18a93e7ee046 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:47:00.884936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 91111d35-9f12-490d-be7e-18a93e7ee046 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:47:02.416031 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d62294ea-c193-4110-a36b-6b2de11653dd req-9b624262-592f-49d3-92d3-af2406d1d8f7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 210 time: 0.0453877 Nov 11 11:47:03.597551 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1ce68734-3223-41d3-a9de-a095c9a59862 req-968bcea4-ad2e-435c-a3a2-429aa9587bca tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 210 time: 0.0492606 Nov 11 11:47:04.535008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-8bcc9950-9d89-4189-8049-a4767b088784 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:04.536944 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-8bcc9950-9d89-4189-8049-a4767b088784 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 812 time: 0.1891394 Nov 11 11:47:04.590014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:04.600930 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-226a0ed8-0b0e-45b0-8841-ae2af6af5a9f tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 380 time: 0.0519538 Nov 11 11:47:04.610665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'port': {'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'admin_state_up': True, 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'security_groups': ['82ca2c36-3087-406f-9689-58bdf145dcc0']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:04.816071 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ec8ece6e-08e4-44e0-8aaa-5da8ec369246 req-47284ae3-c3dc-4014-9753-9635bc50b8ec tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 210 time: 0.0647521 Nov 11 11:47:04.857992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:04.868955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:04.905172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Made reservation on behalf of 1bcfb2b970f34aa9af017e16d6e4c699 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:47:04.910893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:05.085222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Allocated IP 172.20.0.8 (d5ec5e34-ac26-4927-b077-b0742eacb0fd/6e9509c6-37ce-4e40-8036-e5d45e65095d/7d814c54-0cf1-43cc-a16a-8adadf324bde) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:47:05.391652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:05.408224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Transition to ACTIVE for port object 7d814c54-0cf1-43cc-a16a-8adadf324bde will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:47:05.454357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:05.461161 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1a1a973b-b91f-4899-98b1-fd5c92492d90 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:05.539219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:47:05.543238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:47:05.545508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=7d814c54-0cf1-43cc-a16a-8adadf324bde,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:05.548298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:47:05.577389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:05.616527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:05.624099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:05.671682 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0649898 Nov 11 11:47:05.683478 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Request body: {'port': {'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:05.808733 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:05.899570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-a7e27046-36b9-4b69-a9d3-01a18baeaa67 None None] Provisioning for port 7d814c54-0cf1-43cc-a16a-8adadf324bde completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:47:05.905348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-a7e27046-36b9-4b69-a9d3-01a18baeaa67 None None] Provisioning complete for port 7d814c54-0cf1-43cc-a16a-8adadf324bde triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:47:05.905842 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a7e27046-36b9-4b69-a9d3-01a18baeaa67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:05.969439 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-a7e27046-36b9-4b69-a9d3-01a18baeaa67 None None] Port 7d814c54-0cf1-43cc-a16a-8adadf324bde cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:47:06.233776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40794633-3458-48f0-8d3d-b99933f5eeab req-31781749-eefc-4275-90f5-d5379ac396d0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:06.234452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-40794633-3458-48f0-8d3d-b99933f5eeab req-31781749-eefc-4275-90f5-d5379ac396d0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Synchronizing usage tracker for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:47:06.304793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7d814c54-0cf1-43cc-a16a-8adadf324bde {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:47:06.311956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:06.327332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Transition to ACTIVE for port object 7d814c54-0cf1-43cc-a16a-8adadf324bde will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:47:06.328587 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-40794633-3458-48f0-8d3d-b99933f5eeab req-31781749-eefc-4275-90f5-d5379ac396d0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Unset dirty status for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:47:06.330387 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40794633-3458-48f0-8d3d-b99933f5eeab req-31781749-eefc-4275-90f5-d5379ac396d0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 931 time: 0.2339268 Nov 11 11:47:06.355326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:06.365362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:06.733308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Pushing event updated for resources: {'Port': ['ID=7d814c54-0cf1-43cc-a16a-8adadf324bde,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:06.737313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.372s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:06.740089 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40794633-3458-48f0-8d3d-b99933f5eeab req-84d0fd08-b07b-4cc6-8f93-5d0a1e211984 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4034631 Nov 11 11:47:06.848725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Attempting to bind port 7d814c54-0cf1-43cc-a16a-8adadf324bde on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:47:06.849101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Attempting to bind port 7d814c54-0cf1-43cc-a16a-8adadf324bde by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:47:06.849469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Attempting to bind port 7d814c54-0cf1-43cc-a16a-8adadf324bde on network d5ec5e34-ac26-4927-b077-b0742eacb0fd {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:47:06.855691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Port 7d814c54-0cf1-43cc-a16a-8adadf324bde on network d5ec5e34-ac26-4927-b077-b0742eacb0fd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:47:06.856048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Attempting to bind port 7d814c54-0cf1-43cc-a16a-8adadf324bde on network d5ec5e34-ac26-4927-b077-b0742eacb0fd {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:47:06.864131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 47, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:47:06.864507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Checking segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:47:06.864932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Bound using segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:47:06.865398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Bound port: 7d814c54-0cf1-43cc-a16a-8adadf324bde, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:47:06.865787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:06.967487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] For port 7d814c54-0cf1-43cc-a16a-8adadf324bde, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:47:06.971320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] For port 7d814c54-0cf1-43cc-a16a-8adadf324bde, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:47:07.014392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:07.019329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dee32a38-8a15-4ebb-9a7f-765d77ca0d74 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:07.075028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:07.076525 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] 10.222.0.60 "PUT /v2.0/ports/7d814c54-0cf1-43cc-a16a-8adadf324bde HTTP/1.1" status: 200 len: 1093 time: 1.3978295 Nov 11 11:47:07.077052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:07.101430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Pushing event updated for resources: {'Port': ['ID=7d814c54-0cf1-43cc-a16a-8adadf324bde,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:07.104713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:07.142222 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'status': 'completed', 'code': 200} Nov 11 11:47:07.259015 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40a22529-96a9-4241-921b-38ecf1a50efc req-1ebe2250-b481-4627-8b00-4538ea935b37 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 1096 time: 0.0916569 Nov 11 11:47:07.414176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a22529-96a9-4241-921b-38ecf1a50efc req-78be7e6c-d056-43bb-aac5-9c398289d0a5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:07.415711 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40a22529-96a9-4241-921b-38ecf1a50efc req-78be7e6c-d056-43bb-aac5-9c398289d0a5 service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&shared=False HTTP/1.1" status: 200 len: 914 time: 0.1483774 Nov 11 11:47:07.577129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a22529-96a9-4241-921b-38ecf1a50efc req-350f814c-654c-49f6-ade4-9ce98d8c88eb service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:07.578723 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40a22529-96a9-4241-921b-38ecf1a50efc req-350f814c-654c-49f6-ade4-9ce98d8c88eb service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1565237 Nov 11 11:47:07.691745 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-f86e2de6-a978-48d4-81c2-00f110b49923 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 1096 time: 0.0733132 Nov 11 11:47:07.769715 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-1c4a6080-f019-459d-97ee-e219072b057d service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde HTTP/1.1" status: 200 len: 217 time: 0.0674038 Nov 11 11:47:07.839721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-e4cf74d5-9e98-4ff1-9405-80350b2f0e68 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:07.841246 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-e4cf74d5-9e98-4ff1-9405-80350b2f0e68 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.0651698 Nov 11 11:47:07.996076 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-e5f13471-222a-426c-abfe-08fd7816bce8 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1407628 Nov 11 11:47:08.002955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c5f829-cb18-4dde-82e8-d99fcbe15af6 req-427f83e4-7960-4c22-8a39-6fd075c05bc0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:08.004457 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-95c5f829-cb18-4dde-82e8-d99fcbe15af6 req-427f83e4-7960-4c22-8a39-6fd075c05bc0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 943 time: 0.1173425 Nov 11 11:47:08.158511 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-95c5f829-cb18-4dde-82e8-d99fcbe15af6 req-eda71ee4-fa26-4abb-91a6-cf1350e7a885 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1309967 Nov 11 11:47:08.182140 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-7c4ee1e0-c2a8-470c-b0b3-4573d27d521a service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1766617 Nov 11 11:47:08.331220 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db34c724-941b-4bfa-91c0-e059203d62b2 req-9667b908-8896-4aa2-a0b0-34bea4898137 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1410611 Nov 11 11:47:09.402913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb79d33a-cd70-4893-a08b-aa4aba9e63b5 req-016407ee-e9af-4579-abc9-e14b9dfb5a38 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:09.404656 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eb79d33a-cd70-4893-a08b-aa4aba9e63b5 req-016407ee-e9af-4579-abc9-e14b9dfb5a38 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 943 time: 0.0934234 Nov 11 11:47:09.453273 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eb79d33a-cd70-4893-a08b-aa4aba9e63b5 req-d9f18558-c973-496a-857c-68a2f16c3de3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416524 Nov 11 11:47:09.934866 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-36917180-6fd8-4495-be8f-d3e7c7273282 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0731432 Nov 11 11:47:10.002669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e09b15a7-ecc0-4ba4-b393-8ede2c8dce30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:10.035527 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-9526be59-6098-4b18-b7f7-22749d7ce596 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 1100 time: 0.0761814 Nov 11 11:47:10.204023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-27969d2d-8ac7-48cb-9614-9916ee576f63 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:10.205653 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-27969d2d-8ac7-48cb-9614-9916ee576f63 service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.1372440 Nov 11 11:47:10.308137 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-ea8422a0-8c10-4450-aec9-3a08832f518e service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=48b55264-0eab-46d7-abe8-ce455a036f49 HTTP/1.1" status: 200 len: 1001 time: 0.0962601 Nov 11 11:47:10.382801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-781e603f-3776-4eea-87a7-f0321c7db062 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:10.384425 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-781e603f-3776-4eea-87a7-f0321c7db062 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0704687 Nov 11 11:47:10.465642 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-cd89d3ff-9114-43b6-8e75-8dbbc232c86a service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0737088 Nov 11 11:47:10.665280 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-ca9e0ae7-1c89-4e55-8909-08ce21b6576a service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1934237 Nov 11 11:47:10.784518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be7b309-272a-4707-90ef-5bb66cdcd44c req-25f1b536-cc83-41dd-8c8d-979ef5043a07 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:10.786033 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1be7b309-272a-4707-90ef-5bb66cdcd44c req-25f1b536-cc83-41dd-8c8d-979ef5043a07 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 943 time: 0.2022920 Nov 11 11:47:10.865385 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-96ee60e9-2d1e-4801-af86-a6ba0329c12b req-5582720f-c40f-4611-9512-0b1c3aef0968 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1922510 Nov 11 11:47:10.869318 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1be7b309-272a-4707-90ef-5bb66cdcd44c req-7d8c5560-631d-45c8-a24a-23f38f4bb848 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754631 Nov 11 11:47:11.265271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:12.075692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cb7f4ed-9beb-449d-b23a-96f7d581e7d1 req-9f1c8459-b49f-40c2-9ae7-20cefa2e63dd tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:12.077288 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5cb7f4ed-9beb-449d-b23a-96f7d581e7d1 req-9f1c8459-b49f-40c2-9ae7-20cefa2e63dd tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 943 time: 0.0815437 Nov 11 11:47:12.125035 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5cb7f4ed-9beb-449d-b23a-96f7d581e7d1 req-ac2719a1-d1aa-45bf-bb67-6f813b574313 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414608 Nov 11 11:47:13.329413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b438aba6-635f-43af-aa6e-427fe44603c5 req-281cb689-6a64-4511-9eb9-4b7f5657eee1 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:13.331021 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b438aba6-635f-43af-aa6e-427fe44603c5 req-281cb689-6a64-4511-9eb9-4b7f5657eee1 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 943 time: 0.0856185 Nov 11 11:47:13.380786 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b438aba6-635f-43af-aa6e-427fe44603c5 req-df62c8e0-56cb-4505-9f2e-c720a73bf663 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435352 Nov 11 11:47:13.493514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-96e112bc-fce7-40ca-ba73-f1af9f331ae1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:13.510475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:14.586695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f04da5c6-2f50-42b3-a097-a0bdd93fb082 req-9c64b54c-5555-4224-b161-9429d14e20a5 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:14.588382 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f04da5c6-2f50-42b3-a097-a0bdd93fb082 req-9c64b54c-5555-4224-b161-9429d14e20a5 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 943 time: 0.0835462 Nov 11 11:47:14.639876 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f04da5c6-2f50-42b3-a097-a0bdd93fb082 req-d8be6f17-f15d-42eb-bac1-561fc52c1c11 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436823 Nov 11 11:47:14.652251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:15.852984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5614862-3853-45c1-9d3c-059dacd81b99 req-1d94b916-8b52-42dd-9d8f-c9cd10d3de85 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:15.854583 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f5614862-3853-45c1-9d3c-059dacd81b99 req-1d94b916-8b52-42dd-9d8f-c9cd10d3de85 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 943 time: 0.0888603 Nov 11 11:47:15.904702 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f5614862-3853-45c1-9d3c-059dacd81b99 req-8dd1506f-8379-43d9-ba94-6e403931290c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438302 Nov 11 11:47:16.922834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 7d814c54-0cf1-43cc-a16a-8adadf324bde details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:47:17.126048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 7d814c54-0cf1-43cc-a16a-8adadf324bde, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:17.140580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1015, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:47:17.201878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:17.222703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7d814c54-0cf1-43cc-a16a-8adadf324bde {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:47:17.264480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 7d814c54-0cf1-43cc-a16a-8adadf324bde, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:17.299700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:17.301674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:17.371773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=7d814c54-0cf1-43cc-a16a-8adadf324bde,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:17.381838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.382231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.382614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.382993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.383399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.383801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.384177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.384570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.384943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.385311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.385680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:17.390088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:17.446610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b9b1dd-6194-4d64-b30a-b020f95f4981 req-3ed8a14c-f6ba-42ad-8e64-a8adbcba5499 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:17.448281 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-79b9b1dd-6194-4d64-b30a-b020f95f4981 req-3ed8a14c-f6ba-42ad-8e64-a8adbcba5499 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 943 time: 0.3531041 Nov 11 11:47:17.508735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be1d8db-de90-4ce1-ba21-25dc2809c735 req-dd4c90b6-b7c3-4bd9-8cbd-14272ebcddec tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:17.510258 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5be1d8db-de90-4ce1-ba21-25dc2809c735 req-dd4c90b6-b7c3-4bd9-8cbd-14272ebcddec tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 947 time: 0.3595679 Nov 11 11:47:17.521853 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-79b9b1dd-6194-4d64-b30a-b020f95f4981 req-9cfb56de-424f-495a-a355-d6defba79135 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0659535 Nov 11 11:47:17.580623 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5be1d8db-de90-4ce1-ba21-25dc2809c735 req-74e52711-f83a-4a51-be56-19fb1306e47a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494044 Nov 11 11:47:17.731340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['7d814c54-0cf1-43cc-a16a-8adadf324bde'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:47:18.799257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9486b6cf-d693-4f6c-bfb8-add4b8f94318 req-2334b582-6610-4800-ad63-60756d4be77b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:18.800828 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9486b6cf-d693-4f6c-bfb8-add4b8f94318 req-2334b582-6610-4800-ad63-60756d4be77b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 944 time: 0.1482182 Nov 11 11:47:18.866035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc64e88-1038-4b91-86d4-711906798e12 req-882e30fb-7099-43a4-a054-1ad05154d327 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:18.867717 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dcc64e88-1038-4b91-86d4-711906798e12 req-882e30fb-7099-43a4-a054-1ad05154d327 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 947 time: 0.1361382 Nov 11 11:47:18.899576 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9486b6cf-d693-4f6c-bfb8-add4b8f94318 req-678e625d-04ef-434e-83c5-abaf5b3963aa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0913515 Nov 11 11:47:18.932999 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dcc64e88-1038-4b91-86d4-711906798e12 req-ffacb7ec-6b90-4e6f-bc19-67bc9f878253 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=9c29ba10-7781-4132-85a5-1106bd95cd6b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575004 Nov 11 11:47:18.948729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 7d814c54-0cf1-43cc-a16a-8adadf324bde up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:47:19.036808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-c81b6770-ccac-4643-b77f-e24076624239 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:19.038352 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-c81b6770-ccac-4643-b77f-e24076624239 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 947 time: 0.0944774 Nov 11 11:47:19.059013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 7d814c54-0cf1-43cc-a16a-8adadf324bde completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:47:19.065763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 7d814c54-0cf1-43cc-a16a-8adadf324bde triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:47:19.066129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:19.112431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Deleting port 48b55264-0eab-46d7-abe8-ce455a036f49 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:47:19.112817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:19.184397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:19.212778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:19.223561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 7d814c54-0cf1-43cc-a16a-8adadf324bde, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:19.259265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:19.261329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:19.334900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=7d814c54-0cf1-43cc-a16a-8adadf324bde,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:19.338642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:19.374267 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'code': 200} Nov 11 11:47:19.381877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] For port 48b55264-0eab-46d7-abe8-ce455a036f49, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=48b55264-0eab-46d7-abe8-ce455a036f49,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:19.382279 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:19.754644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:19.755058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:19.755442 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Floating IP 0420fa6c-3891-40f6-9f28-c86b5986dbc2 disassociated. External IP: 172.27.3.92, port: 48b55264-0eab-46d7-abe8-ce455a036f49. Nov 11 11:47:19.755834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Calling delete_port for 48b55264-0eab-46d7-abe8-ce455a036f49 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:47:19.855992 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2fcb48da-e27b-4105-9f4a-474f5bad1cb6 req-8df924ce-1bc1-4882-ba70-8cfdb4e21a04 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 1098 time: 0.1671686 Nov 11 11:47:19.903117 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2fcb48da-e27b-4105-9f4a-474f5bad1cb6 req-97e9028e-d84b-46f4-bc1c-fd3380183da7 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406845 Nov 11 11:47:20.070425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:20.081715 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:20.172227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event deleted for resources: {'Port': ['ID=48b55264-0eab-46d7-abe8-ce455a036f49,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:20.178628 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-48e7f3da-a3bb-49f8-b29c-ab7db22e3c1f req-6af50adb-b1ad-4e10-957f-4c0cc9870d89 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 210 time: 0.0980713 Nov 11 11:47:20.180175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:20.278708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e6d3b4-d997-4723-a6b1-80956778c611 req-6146b13b-2f4a-4e3c-9a2a-3bb6485b8a52 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:20.280314 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-56e6d3b4-d997-4723-a6b1-80956778c611 req-6146b13b-2f4a-4e3c-9a2a-3bb6485b8a52 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.2499211 Nov 11 11:47:20.400708 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-56e6d3b4-d997-4723-a6b1-80956778c611 req-a74f56b9-6397-4c60-9b02-d36cf57ac41c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1122470 Nov 11 11:47:20.457698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Router b0d78112-9416-496e-b447-57849419e81d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:47:20.687954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:47:20.704037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] Sync routers for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:47:20.718765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:47:20.720550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:20.764162 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] No DVR routers for this DVR port 48b55264-0eab-46d7-abe8-ce455a036f49 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:47:20.767260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:20.773452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-deleted', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:20.781820 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a70151c4-0236-4cfa-8674-a62b90ea7e1e req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "DELETE /v2.0/ports/48b55264-0eab-46d7-abe8-ce455a036f49 HTTP/1.1" status: 204 len: 173 time: 1.7383163 Nov 11 11:47:20.837156 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b3724653-14b4-4882-9c97-ddf2a45306bf', 'name': 'network-vif-deleted', 'tag': '48b55264-0eab-46d7-abe8-ce455a036f49', 'status': 'completed', 'code': 200} Nov 11 11:47:20.928793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:47:21.304136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:21.309027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] Checking router: b0d78112-9416-496e-b447-57849419e81d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:47:21.322596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:47:21.323349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:21.403217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-2e071f3e-0b69-4358-8cab-15d2ae3a383c req-cb536e10-2bb5-4b76-8eae-5071766a1792 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Synchronizing usage tracker for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:47:21.459688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-2e071f3e-0b69-4358-8cab-15d2ae3a383c req-cb536e10-2bb5-4b76-8eae-5071766a1792 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Unset dirty status for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:47:21.471287 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2e071f3e-0b69-4358-8cab-15d2ae3a383c req-cb536e10-2bb5-4b76-8eae-5071766a1792 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b3724653-14b4-4882-9c97-ddf2a45306bf HTTP/1.1" status: 200 len: 210 time: 0.1218145 Nov 11 11:47:21.635977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516739fe-b0ff-4e27-a396-ffc921c595e4 req-65351f27-66fe-4a97-8f4c-b119a13194ba tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:21.637583 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-516739fe-b0ff-4e27-a396-ffc921c595e4 req-65351f27-66fe-4a97-8f4c-b119a13194ba tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.0844676 Nov 11 11:47:21.687036 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-516739fe-b0ff-4e27-a396-ffc921c595e4 req-0c56ada0-6eeb-4790-b2d7-21427cd48c65 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429158 Nov 11 11:47:21.689752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:47:21.897670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271899fa-3f7e-4856-92bd-b085ea40ecbd req-0d7d66a7-9b55-4ef9-a2c8-938af5f75638 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:21.899291 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-271899fa-3f7e-4856-92bd-b085ea40ecbd req-0d7d66a7-9b55-4ef9-a2c8-938af5f75638 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.0873389 Nov 11 11:47:21.950099 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-271899fa-3f7e-4856-92bd-b085ea40ecbd req-2da25701-12a8-4c43-af14-30b0269c973a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445287 Nov 11 11:47:21.981078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 37750) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:22.026388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:22.030510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a21efd6-44cc-4e16-98f4-e42fc1a90cce None None] The sync data for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi is: [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:47:22.057789 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-483042ff-7f1f-4f06-bf3d-78acf0f3b3c8 tempest-TestVolumeBootPattern-1492948392 tempest-TestVolumeBootPattern-1492948392-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 1093 time: 0.0751505 Nov 11 11:47:22.060595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 37754) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:22.066844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address': '172.20.0.8'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:22.072962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:22.077519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:floatingip and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:22.081314 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:22.087647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:22.132034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:22.279719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:22.429300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Allocated IP 172.27.3.111 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/4789aee2-2728-4e8b-b0f1-5aa103146372) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:47:22.481368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-715547ca-98ec-418b-a0f1-aae73a93244f None None] New status for floating IP 0420fa6c-3891-40f6-9f28-c86b5986dbc2: DOWN {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:47:22.716441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 37764) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:22.744246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:22.816281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb964297-eddb-49cb-8854-857a08300800 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:22.849422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb964297-eddb-49cb-8854-857a08300800 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:22.864719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:22.872494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ff59930c-9362-4e6b-9324-97594be342ef service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:22.949603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:47:22.960021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:47:22.968171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:47:22.975092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:47:22.984563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 48b55264-0eab-46d7-abe8-ce455a036f49 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:47:22.984961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 48b55264-0eab-46d7-abe8-ce455a036f49 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:47:23.012103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=4789aee2-2728-4e8b-b0f1-5aa103146372,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:23.021840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:23.133702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb964297-eddb-49cb-8854-857a08300800 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:23.142864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d5916242-f439-40f9-baa0-be434f03c15e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:23.166313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb964297-eddb-49cb-8854-857a08300800 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c29ba10-7781-4132-85a5-1106bd95cd6b,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:23.176436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cb964297-eddb-49cb-8854-857a08300800 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:23.281609 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb964297-eddb-49cb-8854-857a08300800 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:23.283410 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cb964297-eddb-49cb-8854-857a08300800 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "DELETE /v2.0/security-groups/9c29ba10-7781-4132-85a5-1106bd95cd6b HTTP/1.1" status: 204 len: 168 time: 0.5659199 Nov 11 11:47:23.286460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37768) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:23.305728 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.v2.resource [None req-61ac1fd6-3215-48f4-8f9c-bb0044fe81d8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] show failed (client error): The resource could not be found. Nov 11 11:47:23.309629 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-61ac1fd6-3215-48f4-8f9c-bb0044fe81d8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups/9c29ba10-7781-4132-85a5-1106bd95cd6b HTTP/1.1" status: 404 len: 347 time: 0.0193455 Nov 11 11:47:23.309975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37772) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:23.481614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Deleting port c52ef870-29d3-4377-bc18-f2e462a7614d {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:47:23.481990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:23.698175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:23.698827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:23.800064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:23.827816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Calling delete_port for c52ef870-29d3-4377-bc18-f2e462a7614d owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:47:23.896036 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:24.074865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:24.080933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5e22a2f0-0a02-4ce7-8c27-d491cedd0d50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:24.117989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:24.123644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event deleted for resources: {'Port': ['ID=c52ef870-29d3-4377-bc18-f2e462a7614d,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:24.136601 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.137020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.137427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.138370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.138370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.138665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.139068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.139488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.139883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.140276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.140669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:24.160483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:24.165300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:24.168048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:24.236487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:24.273661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=4789aee2-2728-4e8b-b0f1-5aa103146372,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:24.278032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:24.289635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:24.293698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:24.294979 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "DELETE /v2.0/floatingips/0420fa6c-3891-40f6-9f28-c86b5986dbc2 HTTP/1.1" status: 204 len: 168 time: 0.9840124 Nov 11 11:47:24.496876 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Floating IP dbf631b2-047a-4637-bc90-cce0a9808eb8 associated. External IP: 172.27.3.111, port: 7d814c54-0cf1-43cc-a16a-8adadf324bde. Nov 11 11:47:24.643473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37778) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:24.649871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1946907658', 'description': 'tempest-description--669745351'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:24.656135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:24.660448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:security_group and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:24.663438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:24.669389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:24.830680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:24.875803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:24.879984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:security_group_rule and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:24.882985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:24.889368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:24.971589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Router e7a84a32-cf44-4d0e-908d-7569d000b45d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:47:25.015817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.054273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.063801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cfc3cf78-57ed-4c45-93f5-9b9b75cd3b61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:25.143938 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bea744fc-9c93-4c10-ad8b-f33108eb55e8,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:25.148176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:25.185143 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.187282 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1613 time: 0.5422895 Nov 11 11:47:25.189889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37782) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:25.196236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'security_group_rule': {'security_group_id': 'bea744fc-9c93-4c10-ad8b-f33108eb55e8', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:25.202623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:25.207305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:security_group_rule and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:25.211217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:25.217928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:25.241190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:47:25.245453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:47:25.258702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:47:25.259416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:25.272776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.288195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.340751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.356545 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.2948294 Nov 11 11:47:25.357443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:25.385755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.389412 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ffb40457-48b4-486d-9cb2-bfe5f30954b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:25.414401 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'status': 'completed', 'code': 200} Nov 11 11:47:25.436927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5aadd3c3-02b4-48bb-8cb3-f8c028c5644e,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:25.441458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:25.467945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:47:25.471315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.472733 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.2816591 Nov 11 11:47:25.475530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37790) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:25.482295 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'security_group_rule': {'security_group_id': 'bea744fc-9c93-4c10-ad8b-f33108eb55e8', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:25.488983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:25.493922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:security_group_rule and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:25.497133 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:25.503894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:25.526378 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-587cd6fb-1404-417e-b844-409c80e0b406 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 1098 time: 0.0816967 Nov 11 11:47:25.541378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.610136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.630530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.639808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cfa4dac9-c315-453a-a890-bb376831d32c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:25.667505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=33626ff3-ca27-4145-9670-29f4ba8d930b,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:25.672618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:25.686976 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-bfe456f6-e1dd-4d86-837b-9528a12db511 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:25.688363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.689171 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-bfe456f6-e1dd-4d86-837b-9528a12db511 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 914 time: 0.1565177 Nov 11 11:47:25.690494 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.2136512 Nov 11 11:47:25.693700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37794) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:25.699846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:25.706527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:25.710777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:floatingip and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:25.713893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:25.720430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:25.768823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.802344 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-fd074313-1173-437f-a69b-3d605539d6fe service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde HTTP/1.1" status: 200 len: 999 time: 0.1069591 Nov 11 11:47:25.878408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-8fd0e971-9c8d-4027-a90e-e35f8a0fc0f8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:25.880262 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-8fd0e971-9c8d-4027-a90e-e35f8a0fc0f8 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.0718274 Nov 11 11:47:25.884479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:23Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:25.889460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:47:25.902714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:47:25.903433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:25.932417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:25.969392 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-2e22121a-48c1-48ed-aeec-2ec5dea4f843 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0825818 Nov 11 11:47:26.092895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Allocated IP 172.27.3.45 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/08fde528-8742-4ae4-9aa6-8ae54a3ea6f9) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:47:26.104481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:47:26.122104 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-76b9c065-4a19-4086-8734-96c184ba5b9d service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1462677 Nov 11 11:47:26.274278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:26.277845 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f5ba21d-b68c-40d9-bdae-36b11127af5e req-6b8bb3e5-abed-4fb3-b2b6-601f81f6c323 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1488647 Nov 11 11:47:26.340041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:26.346627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:26.416978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:47:26.421011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:47:26.424094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:47:26.456217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'Port': ['ID=08fde528-8742-4ae4-9aa6-8ae54a3ea6f9,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:26.459188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:26.512932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:23Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:26.517541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cb0aab5-a914-4929-a4bd-4ebcd9e228be None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:23Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:47:26.597379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:26.696704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:26.885548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d3c7738-1408-46a5-98fe-371ae7141109 None None] New status for floating IP dbf631b2-047a-4637-bc90-cce0a9808eb8: ACTIVE {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:47:26.916118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:26.960490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:26.965385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1ef5608d-9a48-4ac7-9a1a-d05713eb95f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:27.269825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'Port': ['ID=08fde528-8742-4ae4-9aa6-8ae54a3ea6f9,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:27.274514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.309s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:27.285583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:27.337798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:27.339162 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.6442978 Nov 11 11:47:27.578059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:47:27.591500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-ba050ce5-3af6-4813-87de-88d88478f455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Synchronizing usage tracker for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:security_group {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:47:27.659007 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-ba050ce5-3af6-4813-87de-88d88478f455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Unset dirty status for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:security_group {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:47:27.660450 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-ba050ce5-3af6-4813-87de-88d88478f455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1946907658&fields=id&tenant_id=49b88e3cf8f748be91f37e0b9caccf6d HTTP/1.1" status: 200 len: 267 time: 0.1138573 Nov 11 11:47:27.843189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-619f36b8-ff88-4bc4-8569-7a33f63b21f3 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:27.845579 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-619f36b8-ff88-4bc4-8569-7a33f63b21f3 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 816 time: 0.1778038 Nov 11 11:47:27.864970 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-eb951938-1353-4544-95fe-d22c988751b8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/quotas/49b88e3cf8f748be91f37e0b9caccf6d HTTP/1.1" status: 200 len: 375 time: 0.0132763 Nov 11 11:47:27.961407 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-7a2d7c1b-0ed8-45df-9942-45f4d3347d3f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0898774 Nov 11 11:47:28.120673 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-d6a85564-8679-45bc-9735-837f23324ba1 service neutron] 10.222.0.11 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1454668 Nov 11 11:47:28.289512 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-dbaad25b-52f2-4f03-b0fc-806d1db45000 service neutron] 10.222.0.11 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1622663 Nov 11 11:47:28.559514 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-024caf2f-f11d-4d38-aa63-ad1033d740c1 req-fcafc0f3-414d-4c1e-b758-edbd99569571 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 210 time: 0.0554218 Nov 11 11:47:29.751027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f32727cf-f2d9-4964-a157-e12fa746231c req-7a880413-f0db-4cbd-ba44-931ef4687d29 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 210 time: 0.0454297 Nov 11 11:47:30.372300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-38c6135a-0278-4322-8244-af90d481550a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:30.373845 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-38c6135a-0278-4322-8244-af90d481550a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 816 time: 0.3867428 Nov 11 11:47:30.430053 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-5750ef6d-73da-4a9c-908f-d2d9a2485eaf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=49b88e3cf8f748be91f37e0b9caccf6d HTTP/1.1" status: 200 len: 380 time: 0.0443265 Nov 11 11:47:30.439846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'port': {'device_id': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'admin_state_up': True, 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'security_groups': ['bea744fc-9c93-4c10-ad8b-f33108eb55e8']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:30.592975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:30.597577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Usage tracker for resource:port and tenant:49b88e3cf8f748be91f37e0b9caccf6d is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:30.600629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:30.606636 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:30.646214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Made reservation on behalf of 49b88e3cf8f748be91f37e0b9caccf6d for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:47:30.651897 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:30.837138 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Allocated IP 172.20.0.4 (95fd47ac-3c3a-4852-88d6-8eed6cc12159/438f756e-e154-4e6d-b79f-74ad54d1cabe/99e8580d-0f13-4a11-8a52-ea3fd2c9ac30) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:47:31.013415 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2c4f26f7-5bd9-4486-97c8-b0f5ba49d712 req-9d03b770-dfd5-4b4d-b505-f6ec395b49d7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 210 time: 0.1145167 Nov 11 11:47:31.087167 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:31.104166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Transition to ACTIVE for port object 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:47:31.156598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:31.163301 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b487f468-b892-4151-9d65-7270fcca5773 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:31.234869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:47:31.238796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:47:31.243865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:47:31.276460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:31.283022 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:31.319076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:31.319801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:31.379887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9445789 Nov 11 11:47:31.392556 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Request body: {'port': {'device_id': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:31.520243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:31.539079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-9c69dd60-5d88-49e0-ace6-7d74dba02c64 None None] Provisioning for port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:47:31.545212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-9c69dd60-5d88-49e0-ace6-7d74dba02c64 None None] Provisioning complete for port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:47:31.545727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9c69dd60-5d88-49e0-ace6-7d74dba02c64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:31.601981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-9c69dd60-5d88-49e0-ace6-7d74dba02c64 None None] Port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:47:31.927428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:47:31.934404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:31.950233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Transition to ACTIVE for port object 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:47:31.979349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:31.984232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f2d1bf3c-d159-42fd-afb1-1075b09be88e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:32.128535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:32.131880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:32.308467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Attempting to bind port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:47:32.308775 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Attempting to bind port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:47:32.309147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Attempting to bind port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 on network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:47:32.327743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a79d93-bf98-4c13-a09d-02e2cdf6c107 req-2e5f0cf1-1d48-4695-a40e-06c712d16ba0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:32.329242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-10a79d93-bf98-4c13-a09d-02e2cdf6c107 req-2e5f0cf1-1d48-4695-a40e-06c712d16ba0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Synchronizing usage tracker for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:47:32.333202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 on network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:47:32.333577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Attempting to bind port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 on network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:47:32.348835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 47, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:47:32.349206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Checking segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:47:32.349613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Bound using segment: {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:47:32.350091 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Bound port: 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '421843b6-0528-41c4-b114-9384539ecc53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1022, 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:47:32.350486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:32.430051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-10a79d93-bf98-4c13-a09d-02e2cdf6c107 req-2e5f0cf1-1d48-4695-a40e-06c712d16ba0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Unset dirty status for tenant:49b88e3cf8f748be91f37e0b9caccf6d on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:47:32.431373 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-10a79d93-bf98-4c13-a09d-02e2cdf6c107 req-2e5f0cf1-1d48-4695-a40e-06c712d16ba0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.2688274 Nov 11 11:47:32.466328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:47:32.482987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:47:32.497073 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-10a79d93-bf98-4c13-a09d-02e2cdf6c107 req-876a79f9-8df4-4783-86c6-ee5d5ed09e41 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567563 Nov 11 11:47:32.515536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:32.524849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d8b8d0bc-0c5a-40ec-a337-909801d67ee9 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:32.584431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:32.585921 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] 10.222.0.60 "PUT /v2.0/ports/99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 HTTP/1.1" status: 200 len: 1093 time: 1.1986682 Nov 11 11:47:32.586449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:32.618098 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:32.627816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:32.647499 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'status': 'completed', 'code': 200} Nov 11 11:47:32.743506 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-d217dd6a-ae03-45db-831e-ead73d6a6ade service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 1096 time: 0.0822895 Nov 11 11:47:32.821349 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-ddad5dda-ef66-43a0-a82d-b9906fa01831 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 HTTP/1.1" status: 200 len: 217 time: 0.0698996 Nov 11 11:47:32.897782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6cca9901-effa-49e3-9a3a-550c19d3111f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:32.899407 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-6cca9901-effa-49e3-9a3a-550c19d3111f service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0719690 Nov 11 11:47:32.988184 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-9f138750-23ca-40ee-a358-e691822a7e8c service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0814211 Nov 11 11:47:33.137966 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-964b49e5-af21-4fc9-860d-2565a5f4d277 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1430056 Nov 11 11:47:33.285382 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0ed6f17-f359-48cb-bfd5-b64ff9948e8e req-f153ec9a-13fd-4e34-8f89-523a5906566f service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1390579 Nov 11 11:47:33.450257 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-67bdc3cb-9d71-4d52-b418-e69b3da3ca7a service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 1096 time: 0.0763674 Nov 11 11:47:33.599305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-89c3957c-1a1d-4871-b60c-27e7f90f5017 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:33.601382 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-89c3957c-1a1d-4871-b60c-27e7f90f5017 service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.1448512 Nov 11 11:47:33.717791 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-326bfdef-4480-47d6-8066-05d9bdb3bb78 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 HTTP/1.1" status: 200 len: 217 time: 0.1086771 Nov 11 11:47:33.799928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-146dda6d-f46e-4ad1-9d3a-2caaf3093658 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:33.801530 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-146dda6d-f46e-4ad1-9d3a-2caaf3093658 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0769026 Nov 11 11:47:33.867931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e3acaf-b337-4149-af98-074475dc2ce9 req-8c31dbb0-7b57-4063-bdd9-b569bf32afce tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:33.869534 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0e3acaf-b337-4149-af98-074475dc2ce9 req-8c31dbb0-7b57-4063-bdd9-b569bf32afce tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.2070863 Nov 11 11:47:33.940615 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-d91d6b3f-881b-49ca-a611-1f84fb988dd7 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1300659 Nov 11 11:47:33.943066 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0e3acaf-b337-4149-af98-074475dc2ce9 req-e5cf16a7-8e46-4f7c-9670-df87addeeb3f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0650032 Nov 11 11:47:34.087321 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-9d4c5539-1088-481f-b16e-9f8fe816e256 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1402752 Nov 11 11:47:34.237264 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f4cd5a90-1bf9-4655-9741-592e03eb31e3 req-cef98026-d765-44bd-8e9e-3015a8a91c4e service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1412880 Nov 11 11:47:34.566934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:35.178857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189d8b04-0adf-42c3-bd85-4414181626bd req-ff6b668e-29af-48c2-a53f-79fda77cd5a2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:35.180497 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-189d8b04-0adf-42c3-bd85-4414181626bd req-ff6b668e-29af-48c2-a53f-79fda77cd5a2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0854728 Nov 11 11:47:35.235497 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-189d8b04-0adf-42c3-bd85-4414181626bd req-1f195eca-5fab-4cb8-b0b9-2ea007e698c1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487144 Nov 11 11:47:36.456042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dee77f2-efff-44da-91d8-a70a7f93ee3b req-2703d58a-63c4-4f1e-a2f5-21e73ff212fb tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:36.457650 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7dee77f2-efff-44da-91d8-a70a7f93ee3b req-2703d58a-63c4-4f1e-a2f5-21e73ff212fb tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0829480 Nov 11 11:47:36.507820 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7dee77f2-efff-44da-91d8-a70a7f93ee3b req-19f82592-5896-4d02-9576-96630500b89d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439060 Nov 11 11:47:37.003806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:47:37.156650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:37.171278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'port_id': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'mac_address': 'fa:16:3e:d8:07:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1022, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:47:37.232514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:37.251465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:47:37.267867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:37.315920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:37.318248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:37.386508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:37.389851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:37.665517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:47:37.995971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e71413e-2607-4339-be24-eea0ad1fe8b1 req-37368562-e314-4290-a8b5-a26cda70582f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:37.997565 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3e71413e-2607-4339-be24-eea0ad1fe8b1 req-37368562-e314-4290-a8b5-a26cda70582f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 944 time: 0.3507311 Nov 11 11:47:38.067977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f897c0-5ef5-415c-8e91-259b70b52b81 req-11f11512-d45d-48fd-9ac9-96db7fd715c3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:38.069555 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-82f897c0-5ef5-415c-8e91-259b70b52b81 req-11f11512-d45d-48fd-9ac9-96db7fd715c3 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.3423150 Nov 11 11:47:38.073418 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3e71413e-2607-4339-be24-eea0ad1fe8b1 req-6beab217-46b5-4b6a-8efe-2f5a00531417 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678630 Nov 11 11:47:38.118044 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-82f897c0-5ef5-415c-8e91-259b70b52b81 req-be788c9c-5022-4317-8ccd-b9c5f0a2e4cf tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421042 Nov 11 11:47:39.020386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:47:39.127840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:47:39.136411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:47:39.137004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:39.202334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-c83b866c-00b9-4a2e-8849-ac212d8ecd9e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:39.204751 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-c83b866c-00b9-4a2e-8849-ac212d8ecd9e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.1054718 Nov 11 11:47:39.397069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Deleting port 4883439e-6709-46bc-b7b3-a1dfa2128b0c {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:47:39.397335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:39.431662 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:39.459562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:39.470309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:39.504578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:39.506595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:39.544183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06450270-a06e-49d9-be0d-e22da45a9fa2 req-48740f06-6e31-455d-8c5d-6957230e8b42 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:39.546536 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-06450270-a06e-49d9-be0d-e22da45a9fa2 req-48740f06-6e31-455d-8c5d-6957230e8b42 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 944 time: 0.2925856 Nov 11 11:47:39.570723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7d6e93-e4bd-427f-8e9f-6899a2018765 req-b8d9b969-6af1-4a7f-b856-bf74af9d5e93 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:39.572439 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b7d6e93-e4bd-427f-8e9f-6899a2018765 req-b8d9b969-6af1-4a7f-b856-bf74af9d5e93 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 946 time: 0.2721064 Nov 11 11:47:39.579846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:39.583052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:39.768816 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-06450270-a06e-49d9-be0d-e22da45a9fa2 req-09c57fa2-7973-4892-aded-37c81dbf8049 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1953013 Nov 11 11:47:39.774091 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b7d6e93-e4bd-427f-8e9f-6899a2018765 req-36988b47-9d36-4f88-9136-f03101b78106 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1660182 Nov 11 11:47:39.796225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] For port 4883439e-6709-46bc-b7b3-a1dfa2128b0c, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4883439e-6709-46bc-b7b3-a1dfa2128b0c,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:39.796634 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:39.838875 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'code': 200} Nov 11 11:47:40.001719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-463e99ac-5a08-4285-a3a7-8adce7f082f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:40.177662 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:40.178211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:40.178330 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Floating IP dcc10784-fe23-4ae4-b39b-f0f518d37c12 disassociated. External IP: 172.27.3.26, port: 4883439e-6709-46bc-b7b3-a1dfa2128b0c. Nov 11 11:47:40.178682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Calling delete_port for 4883439e-6709-46bc-b7b3-a1dfa2128b0c owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:47:40.257170 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-89732655-7ee6-4479-b114-7caf7d093c06 req-44b4f7d1-56f2-4c02-aee2-68c9c7cee6d5 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 1098 time: 0.1662872 Nov 11 11:47:40.365581 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-89732655-7ee6-4479-b114-7caf7d093c06 req-d9e3194e-0ca6-431f-b0fc-d051ddc4f440 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0934896 Nov 11 11:47:40.412073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:40.418187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:40.461196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event deleted for resources: {'Port': ['ID=4883439e-6709-46bc-b7b3-a1dfa2128b0c,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:40.465607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:40.708763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Router bf5e2202-8700-46f0-9f7b-d7820ecb5663 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:47:41.003699 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f47e1be2-7321-4377-abf8-a73a2c543323 req-5ebb58c0-9dd8-408d-a9e6-d2a0bb1a7342 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=13a8a429-0144-4423-a6ab-e219abe2e52d HTTP/1.1" status: 200 len: 210 time: 0.0908711 Nov 11 11:47:41.037557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:47:41.050437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] Sync routers for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:47:41.065395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:47:41.066015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:41.126325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] No DVR routers for this DVR port 4883439e-6709-46bc-b7b3-a1dfa2128b0c on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:47:41.130001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:41.132788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'name': 'network-vif-deleted', 'tag': '4883439e-6709-46bc-b7b3-a1dfa2128b0c'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:41.151754 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5adcee38-2dcf-410d-bfa0-37e1f3b33e74 req-416fedce-c169-489e-bbe8-78474ea599d8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:41.153392 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5adcee38-2dcf-410d-bfa0-37e1f3b33e74 req-416fedce-c169-489e-bbe8-78474ea599d8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.1941121 Nov 11 11:47:41.198117 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '13a8a429-0144-4423-a6ab-e219abe2e52d', 'name': 'network-vif-deleted', 'tag': '4883439e-6709-46bc-b7b3-a1dfa2128b0c', 'status': 'completed', 'code': 200} Nov 11 11:47:41.201469 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1b748764-f8a6-4e75-8967-72c0af2a03ac req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "DELETE /v2.0/ports/4883439e-6709-46bc-b7b3-a1dfa2128b0c HTTP/1.1" status: 204 len: 173 time: 1.9912658 Nov 11 11:47:41.215498 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5adcee38-2dcf-410d-bfa0-37e1f3b33e74 req-d0716bb8-2c5b-4151-baf6-6e7e352c5042 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528846 Nov 11 11:47:41.276254 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:47:41.325861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:41.637272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:41.642338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] Checking router: bf5e2202-8700-46f0-9f7b-d7820ecb5663 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:47:41.655663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:47:41.656349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:41.855929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:47:42.180489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37874) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:42.200926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:42.205980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab1474e3-b0d3-475e-9561-05f39c9e4473 None None] The sync data for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi is: [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:47:42.259643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-60fcbe02-09ee-4276-9df1-e89662874a04 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:42.290848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-60fcbe02-09ee-4276-9df1-e89662874a04 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:42.390683 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-60fcbe02-09ee-4276-9df1-e89662874a04 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:42.395723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-04427fbf-7b59-4758-bde3-d7c5d21bd524 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:42.412319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60fcbe02-09ee-4276-9df1-e89662874a04 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:42.415898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-60fcbe02-09ee-4276-9df1-e89662874a04 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:42.458689 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b19640c2-b7dd-45f1-b2e9-414284d254bb req-33e9f516-a294-40db-9b63-b1fb06148611 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:42.460397 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b19640c2-b7dd-45f1-b2e9-414284d254bb req-33e9f516-a294-40db-9b63-b1fb06148611 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0917852 Nov 11 11:47:42.470764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-60fcbe02-09ee-4276-9df1-e89662874a04 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:42.472019 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-60fcbe02-09ee-4276-9df1-e89662874a04 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "DELETE /v2.0/security-groups/4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b HTTP/1.1" status: 204 len: 168 time: 0.2903624 Nov 11 11:47:42.475742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37880) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:42.495992 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.v2.resource [None req-9645ae24-7f07-42ac-a14a-7a4cd998bd9c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] show failed (client error): The resource could not be found. Nov 11 11:47:42.499618 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9645ae24-7f07-42ac-a14a-7a4cd998bd9c tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups/4d8a6ca7-f9b2-4855-9b92-de5f8ff74d4b HTTP/1.1" status: 404 len: 347 time: 0.0219347 Nov 11 11:47:42.501193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37884) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:42.540837 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b19640c2-b7dd-45f1-b2e9-414284d254bb req-07749229-d0f6-4db6-bef4-c4f8d0b353e1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0734048 Nov 11 11:47:42.674326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3043886e-0220-41dd-9a32-3bcb547e4f78 None None] New status for floating IP dcc10784-fe23-4ae4-b39b-f0f518d37c12: DOWN {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:47:42.700283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Deleting port 1c84c43a-879d-4da9-9c2d-93b42720b1c8 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:47:42.700872 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:42.756390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcffdc42-ce1d-48f6-9701-5db64cad2d2e req-6c71e8e1-a75d-4216-8055-6db26e13e073 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:42.758043 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dcffdc42-ce1d-48f6-9701-5db64cad2d2e req-6c71e8e1-a75d-4216-8055-6db26e13e073 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0928695 Nov 11 11:47:42.768523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 37890) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:42.775102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Request body: {'floatingip': {'port_id': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:42.858619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:42.888078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:42.888454 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:43.027848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Calling delete_port for 1c84c43a-879d-4da9-9c2d-93b42720b1c8 owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:47:43.052821 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 4883439e-6709-46bc-b7b3-a1dfa2128b0c no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:47:43.088223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 4883439e-6709-46bc-b7b3-a1dfa2128b0c {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:47:43.088608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 4883439e-6709-46bc-b7b3-a1dfa2128b0c not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:47:43.163424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 2 row(s); 1 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88328) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:47:43.163800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:47:43.481504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9aaade13-9920-47b0-9c87-6ea450b39386 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:43.510124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:43.664545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Deleting port 1c84c43a-879d-4da9-9c2d-93b42720b1c8 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:47:43.664940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:43.736951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:43.778587 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:43.848379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:43.848742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:43.974849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Calling delete_port for 1c84c43a-879d-4da9-9c2d-93b42720b1c8 owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:47:43.985106 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Floating IP 6949a680-ec2a-4ea5-84e9-e1ec3fde95fc associated. External IP: 172.27.3.45, port: 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30. Nov 11 11:47:44.150235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:44.155065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:44.198272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event deleted for resources: {'Port': ['ID=1c84c43a-879d-4da9-9c2d-93b42720b1c8,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:44.201191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:44.299186 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:44.315334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:44.316552 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "DELETE /v2.0/floatingips/dcc10784-fe23-4ae4-b39b-f0f518d37c12 HTTP/1.1" status: 204 len: 168 time: 1.8143516 Nov 11 11:47:44.397616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Router b0d78112-9416-496e-b447-57849419e81d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:47:44.628164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:47:44.633323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:44.639644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] Sync routers for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:47:44.649162 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:44.659079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:47:44.659948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:44.700289 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-716db276-867c-430c-9fd6-1653477b3e4b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "PUT /v2.0/floatingips/6949a680-ec2a-4ea5-84e9-e1ec3fde95fc HTTP/1.1" status: 200 len: 990 time: 1.9301624 Nov 11 11:47:44.701008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:44.866041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:47:44.896682 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'status': 'completed', 'code': 200} Nov 11 11:47:44.992068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37900) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:44.998395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'security_group': {'name': 'tempest-securitygroup--787540514', 'description': 'tempest-description--996264918'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:45.004670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:45.009040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:security_group and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:45.013541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:45.020779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:45.027089 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-09f992e5-9f4f-408a-8933-1bf2f0cae6ed service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 1098 time: 0.1076219 Nov 11 11:47:45.053356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.096429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:45.101181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:security_group_rule and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:45.104267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:45.110551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:45.174817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.176941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-92ef09be-fb30-47b4-8386-5cd62c510493 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:45.178521 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-92ef09be-fb30-47b4-8386-5cd62c510493 service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.1437342 Nov 11 11:47:45.196036 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.202010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-14f7b579-935d-44df-b382-1fdfa2554679 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:45.249564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b1806054-df1a-4278-a1e2-169d2cc86ffa,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:45.252569 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:45.270728 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.272561 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1612 time: 0.2791426 Nov 11 11:47:45.275874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37904) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:45.289337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'security_group_rule': {'security_group_id': 'b1806054-df1a-4278-a1e2-169d2cc86ffa', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:45.293641 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-01f34058-facf-4637-a9f7-49d4e27f76b5 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 HTTP/1.1" status: 200 len: 998 time: 0.1076083 Nov 11 11:47:45.297838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:45.302184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:security_group_rule and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:45.305567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:45.312501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:45.364078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.387557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-7befa9f0-7631-472a-ba64-38f5474d11d6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:45.390187 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-7befa9f0-7631-472a-ba64-38f5474d11d6 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0850277 Nov 11 11:47:45.444513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '6949a680-ec2a-4ea5-84e9-e1ec3fde95fc', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'floating_ip_address': '172.27.3.45', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'b0d78112-9416-496e-b447-57849419e81d', 'port_id': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'mac_address': 'fa:16:3e:d8:07:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:26Z', 'updated_at': '2021-11-11T11:47:43Z', 'revision_number': 1, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:45.446524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.449159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] Checking router: b0d78112-9416-496e-b447-57849419e81d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:47:45.461362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:47:45.462044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:45.473856 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-15a0fb0c-4707-44f7-8dbb-53dff9c9e9e6 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0768600 Nov 11 11:47:45.487164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.495705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:45.519462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fa54e5c4-76d4-443a-a778-351623fed1e3,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:45.522121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:45.556225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.558011 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8268f439-6616-4ef3-9e99-565e023e554d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.2790666 Nov 11 11:47:45.560838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37908) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:45.568714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'security_group_rule': {'security_group_id': 'b1806054-df1a-4278-a1e2-169d2cc86ffa', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:45.575310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:45.580206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:security_group_rule and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:45.583313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:45.589538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:45.631356 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-ad45ab48-f29e-470d-9358-7b1e31348883 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1494336 Nov 11 11:47:45.637502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.670770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:47:45.704918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.744319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.746487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:45.776666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c126a772-202e-47dd-aadf-f86d07aca10b,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:45.779086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:45.781454 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1adb93c-94ef-47ea-bb8b-feb2d2f9c236 req-8e4a7d74-cd00-4e5d-91e9-0094bf01c394 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1433628 Nov 11 11:47:45.800920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:45.802249 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.2400985 Nov 11 11:47:45.805641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 37912) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:47:45.811550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:45.818109 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:45.822401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Usage tracker for resource:floatingip and tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:47:45.825664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:47:45.831956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:45.870005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:46.037309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:46.065701 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '6949a680-ec2a-4ea5-84e9-e1ec3fde95fc', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'floating_ip_address': '172.27.3.45', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'b0d78112-9416-496e-b447-57849419e81d', 'port_id': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'mac_address': 'fa:16:3e:d8:07:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:26Z', 'updated_at': '2021-11-11T11:47:43Z', 'revision_number': 1, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:47:46.070708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89a7120d-0227-4568-b97b-b12a920cb6a0 None None] The sync data for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi is: [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '6949a680-ec2a-4ea5-84e9-e1ec3fde95fc', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'floating_ip_address': '172.27.3.45', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'b0d78112-9416-496e-b447-57849419e81d', 'port_id': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'mac_address': 'fa:16:3e:d8:07:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:26Z', 'updated_at': '2021-11-11T11:47:43Z', 'revision_number': 1, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:47:46.199099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Allocated IP 172.27.3.151 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/868d3ff5-7a7e-4887-b867-c468dab9561a) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:47:46.370711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:46.423847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:46.428703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:46.433820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-022fbaba-236d-482d-817a-23d2540360f7 None None] New status for floating IP 6949a680-ec2a-4ea5-84e9-e1ec3fde95fc: ACTIVE {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:47:46.493716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:47:46.501811 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:47:46.507229 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:47:46.543394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'Port': ['ID=868d3ff5-7a7e-4887-b867-c468dab9561a,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:46.553001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:46.684018 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:46.780284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:46.997306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:47.034335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:47.039317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a1bbcd26-8c6c-46d4-b9a1-c2d423060b02 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:47.144187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'Port': ['ID=868d3ff5-7a7e-4887-b867-c468dab9561a,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:47.148476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:47.159452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:47.217202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:47.218562 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.4119127 Nov 11 11:47:47.470166 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-c7cebf70-e111-4592-a520-892eaf6f7fc2 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--787540514&fields=id&tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be HTTP/1.1" status: 200 len: 267 time: 0.0462058 Nov 11 11:47:47.640367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-fc9b0e87-fe1c-4dc2-8b58-79d80e156701 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:47.642596 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-fc9b0e87-fe1c-4dc2-8b58-79d80e156701 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 811 time: 0.1650999 Nov 11 11:47:47.660872 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-33439d67-5893-49c8-a8aa-8ed003602fa7 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/quotas/307ee8e0c17a4e1ebce8db1a0c8ca6be HTTP/1.1" status: 200 len: 375 time: 0.0121069 Nov 11 11:47:47.756272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-75c5d103-129e-4578-869b-2939c13003d0 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Synchronizing usage tracker for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:47:47.800621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-75c5d103-129e-4578-869b-2939c13003d0 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Unset dirty status for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:47:47.802101 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-75c5d103-129e-4578-869b-2939c13003d0 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1352065 Nov 11 11:47:48.160284 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-5f1f972a-c7d4-4ae2-8e23-6c7b74bbaea8 service neutron] 10.222.0.11 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3443568 Nov 11 11:47:48.304986 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-788e0b29-0e51-4ad5-8b7f-49eebdf2edae service neutron] 10.222.0.11 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1382873 Nov 11 11:47:48.552384 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-03fcd519-4244-4f2b-95f6-d4b0c0a224c4 req-4c0e7ce2-3eaf-497c-83b0-9cbbf4c4660b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 210 time: 0.0454447 Nov 11 11:47:49.721111 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9dc1c79-7630-4bab-8990-09e16f9beecd req-1758aa8e-8a5f-4b58-863e-2824139e1b1a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 210 time: 0.0448902 Nov 11 11:47:50.070418 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-06b4d475-085c-4d63-8a39-7bf81acc9738 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:50.072022 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-06b4d475-085c-4d63-8a39-7bf81acc9738 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 811 time: 0.1587369 Nov 11 11:47:50.129083 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-8a47d97d-797f-4114-b117-363420a6bb20 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be HTTP/1.1" status: 200 len: 379 time: 0.0451431 Nov 11 11:47:50.138001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'port': {'device_id': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'admin_state_up': True, 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'security_groups': ['b1806054-df1a-4278-a1e2-169d2cc86ffa']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:50.286372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:47:50.296621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:47:50.325932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Made reservation on behalf of 307ee8e0c17a4e1ebce8db1a0c8ca6be for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:47:50.332122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:50.504544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Allocated IP 172.20.0.7 (6f90028e-6513-4ec3-884d-7830777c7626/f175d5dc-0139-4051-bd21-8da204b3ae78/3ce43dc3-653a-4984-859e-a22653f29d63) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:47:50.696721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:50.713219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Transition to ACTIVE for port object 3ce43dc3-653a-4984-859e-a22653f29d63 will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:47:50.767189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:50.774346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:50.841813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Network 6f90028e-6513-4ec3-884d-7830777c7626 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:47:50.850151 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:47:50.852735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:47:50.936743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event updated for resources: {'Port': ['ID=3ce43dc3-653a-4984-859e-a22653f29d63,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:50.973130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.973544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.973951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.974354 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.974751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.975180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.975563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.975962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.976356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.976745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.977142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:47:50.981064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:50.998037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:50.998723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:51.052236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be31ddf-b006-481e-834b-c90c038c82fb req-620d6bff-529a-4be6-b2fe-1cf08f7bdf70 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:51.052999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-4be31ddf-b006-481e-834b-c90c038c82fb req-620d6bff-529a-4be6-b2fe-1cf08f7bdf70 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Synchronizing usage tracker for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:47:51.065454 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9315894 Nov 11 11:47:51.077621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Request body: {'port': {'device_id': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:47:51.107057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-4be31ddf-b006-481e-834b-c90c038c82fb req-620d6bff-529a-4be6-b2fe-1cf08f7bdf70 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Unset dirty status for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:47:51.108370 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4be31ddf-b006-481e-834b-c90c038c82fb req-620d6bff-529a-4be6-b2fe-1cf08f7bdf70 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 931 time: 0.2173104 Nov 11 11:47:51.144076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-934bddcc-7c7b-4814-b63c-3a470f3e8315 None None] Provisioning for port 3ce43dc3-653a-4984-859e-a22653f29d63 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:47:51.149341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-934bddcc-7c7b-4814-b63c-3a470f3e8315 None None] Provisioning complete for port 3ce43dc3-653a-4984-859e-a22653f29d63 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:47:51.149768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-934bddcc-7c7b-4814-b63c-3a470f3e8315 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:51.206955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-934bddcc-7c7b-4814-b63c-3a470f3e8315 None None] Port 3ce43dc3-653a-4984-859e-a22653f29d63 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:47:51.220664 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4be31ddf-b006-481e-834b-c90c038c82fb req-027dd87c-2c6d-47f6-b5e2-b9c4f3719d80 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1054571 Nov 11 11:47:51.233202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:51.597371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3ce43dc3-653a-4984-859e-a22653f29d63 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:47:51.604426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:51.620995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Transition to ACTIVE for port object 3ce43dc3-653a-4984-859e-a22653f29d63 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:47:51.652800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:51.658229 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:51.792104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Pushing event updated for resources: {'Port': ['ID=3ce43dc3-653a-4984-859e-a22653f29d63,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:51.795979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:51.906112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Attempting to bind port 3ce43dc3-653a-4984-859e-a22653f29d63 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:47:51.907095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Attempting to bind port 3ce43dc3-653a-4984-859e-a22653f29d63 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:47:51.907489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Attempting to bind port 3ce43dc3-653a-4984-859e-a22653f29d63 on network 6f90028e-6513-4ec3-884d-7830777c7626 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:47:51.913966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Port 3ce43dc3-653a-4984-859e-a22653f29d63 on network 6f90028e-6513-4ec3-884d-7830777c7626 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:47:51.914336 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Attempting to bind port 3ce43dc3-653a-4984-859e-a22653f29d63 on network 6f90028e-6513-4ec3-884d-7830777c7626 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:47:51.921416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 47, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:47:51.921798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Checking segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:47:51.922224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Bound using segment: {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:47:51.922697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Bound port: 3ce43dc3-653a-4984-859e-a22653f29d63, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '42c776fe-664f-4fda-a846-8702497a4e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:47:51.923090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:52.027588 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] For port 3ce43dc3-653a-4984-859e-a22653f29d63, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:47:52.030808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] For port 3ce43dc3-653a-4984-859e-a22653f29d63, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=3ce43dc3-653a-4984-859e-a22653f29d63,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:47:52.059051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:52.063196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4575e438-4aca-49af-8230-3ec264314416 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:52.123936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:52.126222 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] 10.222.0.60 "PUT /v2.0/ports/3ce43dc3-653a-4984-859e-a22653f29d63 HTTP/1.1" status: 200 len: 1093 time: 1.0531886 Nov 11 11:47:52.134079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'tag': '3ce43dc3-653a-4984-859e-a22653f29d63'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:52.152596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Pushing event updated for resources: {'Port': ['ID=3ce43dc3-653a-4984-859e-a22653f29d63,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:52.156673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:52.218359 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'tag': '3ce43dc3-653a-4984-859e-a22653f29d63', 'status': 'completed', 'code': 200} Nov 11 11:47:52.257347 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-62d27bd7-fc06-43cb-ad0a-93f25f030051 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 1096 time: 0.0792332 Nov 11 11:47:52.346795 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-729380b2-111d-4cb4-982d-91a962c5cdbf service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3ce43dc3-653a-4984-859e-a22653f29d63 HTTP/1.1" status: 200 len: 217 time: 0.0722501 Nov 11 11:47:52.466672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-6e9e4d77-aa0a-4983-b13f-13311baba982 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:52.468111 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-6e9e4d77-aa0a-4983-b13f-13311baba982 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.1155896 Nov 11 11:47:52.542894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ca7d25-de66-4f36-aa13-0752a2b46408 req-d70bfff6-c93e-4b6a-a21f-0d934a125dd6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:52.544453 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d8ca7d25-de66-4f36-aa13-0752a2b46408 req-d70bfff6-c93e-4b6a-a21f-0d934a125dd6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 943 time: 0.1568744 Nov 11 11:47:52.606952 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-080bf922-95c9-4966-bc61-23fdd5987051 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1305356 Nov 11 11:47:52.612793 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d8ca7d25-de66-4f36-aa13-0752a2b46408 req-c759d19c-0d6f-43ad-b24b-99ed364cd796 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0606418 Nov 11 11:47:52.751874 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-b518c61f-b9e1-4f27-b73a-169963c4dc9c service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1380408 Nov 11 11:47:52.895725 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d21d8a50-4e4e-435c-ac54-5ef9eeed3e12 req-54ce2110-ba31-4485-be30-e7ca844ca757 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371717 Nov 11 11:47:53.070311 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-7bb4df65-5804-48c9-a492-eb03ce3eb22b service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 1096 time: 0.0775728 Nov 11 11:47:53.212630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-1cee70d1-826e-4549-8846-357350306d67 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:53.214187 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-1cee70d1-826e-4549-8846-357350306d67 service neutron] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 913 time: 0.1371331 Nov 11 11:47:53.284283 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-5de1660c-aecd-4276-b74c-4ef6c82174e6 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3ce43dc3-653a-4984-859e-a22653f29d63 HTTP/1.1" status: 200 len: 217 time: 0.0630918 Nov 11 11:47:53.355552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-b0dbecf9-50de-4e81-8327-3dda27d45523 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:53.357125 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-b0dbecf9-50de-4e81-8327-3dda27d45523 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.0665922 Nov 11 11:47:53.440019 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-a5b40d7f-0f3f-4ad2-b2e0-599fb86af120 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0754073 Nov 11 11:47:53.583367 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-049260e2-fff7-4315-92e0-018b9ecf0d24 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1345809 Nov 11 11:47:53.739586 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b422fa42-87f2-4353-ab8b-def67fa174e9 req-b96419cd-ad0d-47b7-a819-cf0cce005563 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1496170 Nov 11 11:47:53.826496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11606bf-b031-4128-9e3c-a90f430878a8 req-f0f179a9-bdfe-4b09-a39c-c650026f2e3b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:53.828091 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d11606bf-b031-4128-9e3c-a90f430878a8 req-f0f179a9-bdfe-4b09-a39c-c650026f2e3b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 943 time: 0.0837376 Nov 11 11:47:54.098323 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d11606bf-b031-4128-9e3c-a90f430878a8 req-a7341d62-4c70-4685-9a69-84e7b361fd18 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2640288 Nov 11 11:47:55.302434 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3748f09f-3b53-45f0-af2d-eb5d62d4cb8b req-ad3a7213-4565-4351-af2e-64371db218a4 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:55.303974 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3748f09f-3b53-45f0-af2d-eb5d62d4cb8b req-ad3a7213-4565-4351-af2e-64371db218a4 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 943 time: 0.0811291 Nov 11 11:47:55.355270 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3748f09f-3b53-45f0-af2d-eb5d62d4cb8b req-b658f9c3-8efd-46b3-9ecb-b29fcc917bc2 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450408 Nov 11 11:47:56.566538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493b4998-22a4-41ea-b939-8836f7040cf5 req-413e5e9f-8342-42cc-92cd-db06561ed469 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:56.568192 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-493b4998-22a4-41ea-b939-8836f7040cf5 req-413e5e9f-8342-42cc-92cd-db06561ed469 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 943 time: 0.0868435 Nov 11 11:47:56.617489 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-493b4998-22a4-41ea-b939-8836f7040cf5 req-c2b4b26d-74fd-41c5-9e87-4d855250235b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429630 Nov 11 11:47:57.125370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 3ce43dc3-653a-4984-859e-a22653f29d63 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:47:57.268599 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 3ce43dc3-653a-4984-859e-a22653f29d63, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=3ce43dc3-653a-4984-859e-a22653f29d63,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:57.282825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '3ce43dc3-653a-4984-859e-a22653f29d63', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'port_id': '3ce43dc3-653a-4984-859e-a22653f29d63', 'mac_address': 'fa:16:3e:68:0e:fc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1007, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:47:57.339329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:57.357790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3ce43dc3-653a-4984-859e-a22653f29d63 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:47:57.373592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 3ce43dc3-653a-4984-859e-a22653f29d63, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=3ce43dc3-653a-4984-859e-a22653f29d63,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:57.395310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:57.397146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:57.465612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=3ce43dc3-653a-4984-859e-a22653f29d63,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:57.469536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:57.747466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['3ce43dc3-653a-4984-859e-a22653f29d63'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:47:57.826571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8414e35d-9985-4f55-aae4-2e79b5eb017a req-d40bca2e-a1db-4c24-abbf-0eadf788dfe1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:57.828692 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8414e35d-9985-4f55-aae4-2e79b5eb017a req-d40bca2e-a1db-4c24-abbf-0eadf788dfe1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 944 time: 0.0825117 Nov 11 11:47:57.877338 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8414e35d-9985-4f55-aae4-2e79b5eb017a req-bad27644-9855-4ea8-8d78-d9280a4ee910 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423303 Nov 11 11:47:59.086777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89bb8e6-aae3-461e-9f39-c28e96e7042a req-2ed2c9b8-f1ce-4948-955e-707681908eef tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:47:59.088378 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f89bb8e6-aae3-461e-9f39-c28e96e7042a req-2ed2c9b8-f1ce-4948-955e-707681908eef tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 944 time: 0.0874555 Nov 11 11:47:59.130787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 3ce43dc3-653a-4984-859e-a22653f29d63 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:47:59.136556 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f89bb8e6-aae3-461e-9f39-c28e96e7042a req-87978ac3-a53a-4d0c-848b-45c3c0539a56 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416625 Nov 11 11:47:59.218230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 3ce43dc3-653a-4984-859e-a22653f29d63 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:47:59.223382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 3ce43dc3-653a-4984-859e-a22653f29d63 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:47:59.223800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:59.339475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:59.367061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ce43dc3-653a-4984-859e-a22653f29d63'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:47:59.377861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 3ce43dc3-653a-4984-859e-a22653f29d63, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=3ce43dc3-653a-4984-859e-a22653f29d63,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:47:59.401282 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:47:59.403299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:47:59.437252 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ce43dc3-653a-4984-859e-a22653f29d63', 'code': 200} Nov 11 11:47:59.477023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=3ce43dc3-653a-4984-859e-a22653f29d63,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:47:59.480597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:47:59.717631 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-abd1f370-c908-41de-9d68-dffb29c5bb09 req-98770323-1190-44aa-9978-eeb0c2157745 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 1098 time: 0.0729363 Nov 11 11:47:59.765129 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-abd1f370-c908-41de-9d68-dffb29c5bb09 req-6a953bb3-2eb4-48d4-9817-6642cae7bdb3 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415461 Nov 11 11:48:00.340607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40672c7-912b-4980-8995-0d9309030cf8 req-f186117d-de5d-456b-8208-d9a0e2b97c20 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:48:00.342210 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d40672c7-912b-4980-8995-0d9309030cf8 req-f186117d-de5d-456b-8208-d9a0e2b97c20 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 945 time: 0.0823224 Nov 11 11:48:00.391045 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d40672c7-912b-4980-8995-0d9309030cf8 req-57983cf6-fab3-437a-9dab-889b213e0eae tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413914 Nov 11 11:48:01.599852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1108560f-ca1d-4506-b2f1-54010608064f req-7672d836-6750-491e-9376-50290b6ab638 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:48:01.601445 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1108560f-ca1d-4506-b2f1-54010608064f req-7672d836-6750-491e-9376-50290b6ab638 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 945 time: 0.0862856 Nov 11 11:48:01.651596 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1108560f-ca1d-4506-b2f1-54010608064f req-20bcf0cb-c235-4f80-a90d-a7096c327009 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435126 Nov 11 11:48:01.854572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b329366-5412-44b4-8f67-b94b27accffa req-b1359994-4a51-4506-9182-f2edbc128bff tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:48:01.856247 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b329366-5412-44b4-8f67-b94b27accffa req-b1359994-4a51-4506-9182-f2edbc128bff tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 945 time: 0.0857325 Nov 11 11:48:01.865716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 38000) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:48:01.871903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Request body: {'floatingip': {'port_id': '3ce43dc3-653a-4984-859e-a22653f29d63'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:48:01.956413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:02.776461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:02.812459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:03.012486 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Floating IP b20009a1-3179-46c7-8133-9dc4410aa0b6 associated. External IP: 172.27.3.151, port: 3ce43dc3-653a-4984-859e-a22653f29d63. Nov 11 11:48:03.436737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Router bf5e2202-8700-46f0-9f7b-d7820ecb5663 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:48:03.652825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:48:03.657831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:03.662886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] Sync routers for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:48:03.676108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:48:03.676764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:48:03.718413 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-36ab5a25-5ded-475b-9f68-9419c8dec111 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "PUT /v2.0/floatingips/b20009a1-3179-46c7-8133-9dc4410aa0b6 HTTP/1.1" status: 200 len: 991 time: 1.8514483 Nov 11 11:48:03.719383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'tag': '3ce43dc3-653a-4984-859e-a22653f29d63'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:48:03.870955 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'tag': '3ce43dc3-653a-4984-859e-a22653f29d63', 'status': 'completed', 'code': 200} Nov 11 11:48:03.873078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:48:03.971914 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-77724c1e-36b2-40e2-a186-76f5ecfedd15 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 1098 time: 0.0790360 Nov 11 11:48:04.120792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-bb7af9eb-f693-4766-abe5-d88f6efdd326 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:48:04.122358 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-bb7af9eb-f693-4766-abe5-d88f6efdd326 service neutron] 10.222.0.60 "GET /v2.0/networks?id=6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 200 len: 913 time: 0.1434321 Nov 11 11:48:04.231737 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-de4005d6-9a02-4462-976d-3c5a87e54262 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3ce43dc3-653a-4984-859e-a22653f29d63 HTTP/1.1" status: 200 len: 999 time: 0.1016695 Nov 11 11:48:04.252002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'b20009a1-3179-46c7-8133-9dc4410aa0b6', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'floating_ip_address': '172.27.3.151', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'port_id': '3ce43dc3-653a-4984-859e-a22653f29d63', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'mac_address': 'fa:16:3e:68:0e:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:46Z', 'updated_at': '2021-11-11T11:48:02Z', 'revision_number': 1, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:48:04.258427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] Checking router: bf5e2202-8700-46f0-9f7b-d7820ecb5663 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:48:04.269051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:48:04.269746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:47:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:48:04.316505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-80381e1b-5ee1-4c7f-8497-e0a125c693d0 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:48:04.318126 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-80381e1b-5ee1-4c7f-8497-e0a125c693d0 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 200 len: 850 time: 0.0795004 Nov 11 11:48:04.399856 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-ff3bdd74-2ea0-44cc-afba-02eb28ec7e15 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=6f90028e-6513-4ec3-884d-7830777c7626&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0740597 Nov 11 11:48:04.555888 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-89435ee6-bf57-47c8-8937-6fe48b4e842e service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1485302 Nov 11 11:48:04.579590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:48:04.621527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:04.635035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:48:04.703673 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70d20e53-0476-4c1a-8971-4dcdf4f643e7 req-9b358ea6-d880-464d-9570-88eab356abc8 service neutron] 10.222.0.60 "GET /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1407437 Nov 11 11:48:05.010372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'b20009a1-3179-46c7-8133-9dc4410aa0b6', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'floating_ip_address': '172.27.3.151', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'port_id': '3ce43dc3-653a-4984-859e-a22653f29d63', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'mac_address': 'fa:16:3e:68:0e:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:46Z', 'updated_at': '2021-11-11T11:48:02Z', 'revision_number': 1, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:48:05.014595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc0752d1-04fe-4e0e-8b94-7a3ff60a2598 None None] The sync data for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi is: [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'b20009a1-3179-46c7-8133-9dc4410aa0b6', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'floating_ip_address': '172.27.3.151', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'port_id': '3ce43dc3-653a-4984-859e-a22653f29d63', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'mac_address': 'fa:16:3e:68:0e:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:46Z', 'updated_at': '2021-11-11T11:48:02Z', 'revision_number': 1, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:48:05.350917 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cf708ab-5abe-43f0-b91b-30ea951ce092 None None] New status for floating IP b20009a1-3179-46c7-8133-9dc4410aa0b6: ACTIVE {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:48:10.023164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3afa4b5d-5d06-499d-b34e-1524bbe94a50 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:11.270225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:13.492359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12587c27-882f-4dbc-b543-38ef65ecda70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:13.515259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:14.646519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:34.572155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:40.000949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9a3cac2c-d4b6-4c68-98b9-84232e7125b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:41.263244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:41.580773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:48:43.469871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-24a41f26-03c1-493e-8bfc-6518252d365f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:43.485951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:48:44.657797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:04.599964 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:10.005646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-249fed18-0484-4a75-a97d-cdc0ab91cccb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:11.297367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:12.755963 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-37f88380-1917-4383-a43b-265fed873e9e service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1075184 Nov 11 11:49:12.914803 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-6393a075-0744-4165-acad-12e557700a31 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 1098 time: 0.0787556 Nov 11 11:49:13.082449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-cf23dcb0-6e25-44f6-9523-9c489be16bd4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:13.084122 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-cf23dcb0-6e25-44f6-9523-9c489be16bd4 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 914 time: 0.1472614 Nov 11 11:49:13.204409 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-bbfde12a-37a6-407f-8e90-b275377fec72 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde HTTP/1.1" status: 200 len: 1001 time: 0.1132083 Nov 11 11:49:13.277428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-6a9dca3e-8f8c-453c-a54b-fe649ce01923 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:13.279034 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-6a9dca3e-8f8c-453c-a54b-fe649ce01923 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.0681756 Nov 11 11:49:13.367376 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-5a82a686-9599-48f6-9f20-640c28576abf service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0811303 Nov 11 11:49:13.474593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b0388504-addc-4ca2-be12-51f432712335 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:13.496885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:13.520892 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-47650d9a-d9b0-4342-b0cc-f35acd945f6e service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1467152 Nov 11 11:49:13.669889 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45deb96f-5ae8-46fc-a3c7-400b87acf78e req-40d1562c-80d8-4beb-a412-a23a19dfba6a service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1418793 Nov 11 11:49:14.380320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d02d9262-03c3-444e-92dc-17744be4eb1a req-e67ad468-104d-4dda-888d-82036ccdb268 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:14.382048 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d02d9262-03c3-444e-92dc-17744be4eb1a req-e67ad468-104d-4dda-888d-82036ccdb268 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0851619 Nov 11 11:49:14.431797 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d02d9262-03c3-444e-92dc-17744be4eb1a req-db05d913-99ef-4b07-9576-24b7d511d5f6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435104 Nov 11 11:49:14.668654 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:15.658230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9075a2cc-12d1-430d-a234-e1686996d01d req-220dde90-2b93-4bfc-af34-5d130f96d530 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:15.659979 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9075a2cc-12d1-430d-a234-e1686996d01d req-220dde90-2b93-4bfc-af34-5d130f96d530 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0878170 Nov 11 11:49:15.709951 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9075a2cc-12d1-430d-a234-e1686996d01d req-b2789a85-17aa-4c6b-a434-92e07042baf5 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433443 Nov 11 11:49:16.939660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f94713b-aec7-42e5-91b3-56dc67401db2 req-8fd1b0e5-8789-440d-b011-83c34a9ed42c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:16.941590 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9f94713b-aec7-42e5-91b3-56dc67401db2 req-8fd1b0e5-8789-440d-b011-83c34a9ed42c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0942926 Nov 11 11:49:17.002712 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9f94713b-aec7-42e5-91b3-56dc67401db2 req-f6f6823a-4ed3-4d06-929b-d1ee92a741b0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522170 Nov 11 11:49:18.228451 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04eb2ab7-75a2-422b-a3bf-57d4f70c7184 req-b0678d74-5942-43e3-a6af-1a59b468fd12 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:18.230044 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-04eb2ab7-75a2-422b-a3bf-57d4f70c7184 req-b0678d74-5942-43e3-a6af-1a59b468fd12 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0862882 Nov 11 11:49:18.279282 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-04eb2ab7-75a2-422b-a3bf-57d4f70c7184 req-0b7d5774-92fc-4dd1-ad53-59bed69178c2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425012 Nov 11 11:49:18.581214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:49:19.500278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26ec8360-754c-413f-91b8-ba86e9ba9020 req-6461de73-8153-49ec-ad51-301e84b57a98 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:19.501844 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-26ec8360-754c-413f-91b8-ba86e9ba9020 req-6461de73-8153-49ec-ad51-301e84b57a98 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0849497 Nov 11 11:49:19.556081 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-26ec8360-754c-413f-91b8-ba86e9ba9020 req-904fa084-cf68-4f5d-b30e-8fb93a3bb2e0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479147 Nov 11 11:49:20.773521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf7d786-2e79-4d62-918f-3174c4c84736 req-2c54ba8f-5b42-4c08-a64a-40b26895ec8b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:20.775120 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aaf7d786-2e79-4d62-918f-3174c4c84736 req-2c54ba8f-5b42-4c08-a64a-40b26895ec8b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0836275 Nov 11 11:49:20.822703 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aaf7d786-2e79-4d62-918f-3174c4c84736 req-b681880f-e140-4861-aa81-d2b2cc26af50 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414312 Nov 11 11:49:22.054692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c26504-024a-4794-bdd2-2fa57b6c8a99 req-e163d1e1-482e-40d9-a6c5-ed45a06b5792 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:22.056352 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-90c26504-024a-4794-bdd2-2fa57b6c8a99 req-e163d1e1-482e-40d9-a6c5-ed45a06b5792 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0945661 Nov 11 11:49:22.105805 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-90c26504-024a-4794-bdd2-2fa57b6c8a99 req-12602b54-3ce7-41da-8cf5-a33a308e7f2d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420971 Nov 11 11:49:23.323115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa7a1f4d-58b9-4da6-b7ec-119ef5815b7a req-1b2438d0-27c6-497d-9237-0a4b66ef373e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:23.324728 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa7a1f4d-58b9-4da6-b7ec-119ef5815b7a req-1b2438d0-27c6-497d-9237-0a4b66ef373e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0814347 Nov 11 11:49:23.375084 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa7a1f4d-58b9-4da6-b7ec-119ef5815b7a req-2ab8e458-a73c-43fa-a1a6-7c784c063cb9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433483 Nov 11 11:49:24.604602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1428222-f307-4f83-817b-eb36fbd62a2c req-ab58d0cf-e3ca-49ad-9057-93b04c8a11f1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:24.606219 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a1428222-f307-4f83-817b-eb36fbd62a2c req-ab58d0cf-e3ca-49ad-9057-93b04c8a11f1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0887520 Nov 11 11:49:24.656486 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a1428222-f307-4f83-817b-eb36fbd62a2c req-faad5cbe-289f-4304-be64-56508b487dd6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431159 Nov 11 11:49:25.880550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055c5580-9d9b-4912-83e3-294e967c3d19 req-db3a3b11-b757-4f67-80d7-76bbdfa12595 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:25.882085 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-055c5580-9d9b-4912-83e3-294e967c3d19 req-db3a3b11-b757-4f67-80d7-76bbdfa12595 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0843649 Nov 11 11:49:25.938184 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-055c5580-9d9b-4912-83e3-294e967c3d19 req-69d8d37f-c7fc-45cb-811f-f7ad8c2fb5d7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494628 Nov 11 11:49:27.173045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1c8d1c-7892-40a2-b38a-250ff17ab547 req-454a4358-c0cc-47ef-915f-ec8ee1b1ad12 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:27.174552 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7f1c8d1c-7892-40a2-b38a-250ff17ab547 req-454a4358-c0cc-47ef-915f-ec8ee1b1ad12 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0858157 Nov 11 11:49:27.223375 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7f1c8d1c-7892-40a2-b38a-250ff17ab547 req-aa142d24-0825-47cc-a127-a19b69519dbe tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425351 Nov 11 11:49:27.589968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:49:27.733560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:49:27.751183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'port_id': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'mac_address': 'fa:16:3e:d8:07:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1022, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:49:27.806014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:27.823920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:49:27.839366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:49:27.861918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:27.864655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:49:27.934582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=6']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:49:27.943948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.944347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.944732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.945115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.945489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.945864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.946237 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.946612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.946984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.947410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.947783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:27.952691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:49:27.955619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:49:28.445544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4067e32-a9e4-43cd-b819-a5c893efad86 req-a8d438b0-9460-4ebc-b931-556df6c48670 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:28.447107 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a4067e32-a9e4-43cd-b819-a5c893efad86 req-a8d438b0-9460-4ebc-b931-556df6c48670 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 944 time: 0.0861211 Nov 11 11:49:28.494688 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a4067e32-a9e4-43cd-b819-a5c893efad86 req-e939a7a3-acba-459b-9473-306f99cbd67a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413942 Nov 11 11:49:29.633714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:49:29.706089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:49:29.706516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:29.713436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d73a70f-8904-4934-bb2e-1a98e8938a60 req-db630b8a-de1c-435b-9424-1af5de263d59 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:29.715044 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5d73a70f-8904-4934-bb2e-1a98e8938a60 req-db630b8a-de1c-435b-9424-1af5de263d59 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 944 time: 0.0838554 Nov 11 11:49:29.763402 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5d73a70f-8904-4934-bb2e-1a98e8938a60 req-0eac8d85-2324-46a9-a4a9-fba772eaa9eb tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417244 Nov 11 11:49:29.825817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:29.853571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:49:29.864875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:49:29.902475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:29.904375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:49:29.938859 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'code': 200} Nov 11 11:49:29.973949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=7']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:49:29.977135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:49:30.985377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5e71037-9484-4990-b6ec-8956ecc60a1e req-d2a9df30-ddf7-4307-a3bf-bbddae60e303 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:30.986965 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d5e71037-9484-4990-b6ec-8956ecc60a1e req-d2a9df30-ddf7-4307-a3bf-bbddae60e303 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0878992 Nov 11 11:49:31.035487 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d5e71037-9484-4990-b6ec-8956ecc60a1e req-da60dfbf-2867-4695-8f4c-7aa1cf060c1b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421576 Nov 11 11:49:32.249125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f65a173-e803-4cae-b46e-1077511d0507 req-79842075-8a9d-4b78-a9b8-7fdaddb3e86d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:32.251334 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0f65a173-e803-4cae-b46e-1077511d0507 req-79842075-8a9d-4b78-a9b8-7fdaddb3e86d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0815747 Nov 11 11:49:32.298070 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0f65a173-e803-4cae-b46e-1077511d0507 req-f955a292-8f07-485f-a568-2635188fcc63 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402038 Nov 11 11:49:33.528319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53823490-bfbc-4c30-880b-0595b03866a2 req-8336b99f-a169-49d4-8cc8-8f8a7ac37906 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:33.537236 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-53823490-bfbc-4c30-880b-0595b03866a2 req-8336b99f-a169-49d4-8cc8-8f8a7ac37906 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.1024559 Nov 11 11:49:33.585757 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-53823490-bfbc-4c30-880b-0595b03866a2 req-aec80e62-f2e1-48d4-9f9f-0354f4333917 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469794 Nov 11 11:49:34.622726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:34.806128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ace349-dae0-4755-aaa7-ff3c33f719b5 req-ceabc030-8127-48e5-a04c-77351f88362a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:34.807750 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-62ace349-dae0-4755-aaa7-ff3c33f719b5 req-ceabc030-8127-48e5-a04c-77351f88362a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0833266 Nov 11 11:49:35.067866 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-62ace349-dae0-4755-aaa7-ff3c33f719b5 req-295aa86d-ff2d-4e1d-a06b-2744278dd2dd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2534144 Nov 11 11:49:36.296695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ec674e-7d15-4f49-8efc-a3f4037ba61f req-e38c1ca8-7b26-47e8-bee1-8826db165788 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:36.305437 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-21ec674e-7d15-4f49-8efc-a3f4037ba61f req-e38c1ca8-7b26-47e8-bee1-8826db165788 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0941772 Nov 11 11:49:36.350925 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-21ec674e-7d15-4f49-8efc-a3f4037ba61f req-40cd6354-184a-4af7-8213-3c2b23471581 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441914 Nov 11 11:49:37.641855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fccada-68cc-4b8a-a378-01e7a04b264c req-2e2296aa-e56e-4162-b98a-fb47f3556f84 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:37.643991 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d8fccada-68cc-4b8a-a378-01e7a04b264c req-2e2296aa-e56e-4162-b98a-fb47f3556f84 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.1494849 Nov 11 11:49:37.705525 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d8fccada-68cc-4b8a-a378-01e7a04b264c req-7f8807bb-a7a3-4087-aa93-f1335ecc35c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535486 Nov 11 11:49:38.941031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c85afd7-6d12-4312-b7c5-836c9aae7158 req-abd4b31f-5499-483b-a267-0290be5dea55 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:38.942882 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2c85afd7-6d12-4312-b7c5-836c9aae7158 req-abd4b31f-5499-483b-a267-0290be5dea55 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0880327 Nov 11 11:49:38.993874 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2c85afd7-6d12-4312-b7c5-836c9aae7158 req-181d8458-3d92-4a3d-b93c-213fb169a20d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449154 Nov 11 11:49:40.022387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ef7b5c98-aba0-4929-8eb0-0f10a5e85e35 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:40.226630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea65ca6-4cae-4c49-901b-87a19ec2fe87 req-5e5e9e22-b96e-4450-86d3-5aeb00c5a156 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:40.228467 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2ea65ca6-4cae-4c49-901b-87a19ec2fe87 req-5e5e9e22-b96e-4450-86d3-5aeb00c5a156 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0948749 Nov 11 11:49:40.288898 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2ea65ca6-4cae-4c49-901b-87a19ec2fe87 req-3abeb26a-78cc-41e0-80b7-ff5f9a7760ef tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531828 Nov 11 11:49:41.285359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:41.547028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7944cbc-56d0-4ed4-a4d7-e0af2e33a578 req-d44b2134-c20c-4bb2-b25f-6948815f1f7f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:41.550399 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d7944cbc-56d0-4ed4-a4d7-e0af2e33a578 req-d44b2134-c20c-4bb2-b25f-6948815f1f7f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.1044028 Nov 11 11:49:41.609659 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d7944cbc-56d0-4ed4-a4d7-e0af2e33a578 req-909218a3-a06e-4a7f-bf29-b0956c151830 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525789 Nov 11 11:49:42.480962 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-6a0bfe6f-8796-434f-a153-0ec65581444a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2053754159&fields=id&tenant_id=1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 267 time: 0.0485272 Nov 11 11:49:42.653610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-6b495f86-9c9e-4644-9602-347f080cd173 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:42.655231 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-6b495f86-9c9e-4644-9602-347f080cd173 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 812 time: 0.1618528 Nov 11 11:49:42.680759 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-cc825771-b633-43f1-8c10-bace5a244d95 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/quotas/1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 375 time: 0.0182543 Nov 11 11:49:42.799632 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b34fc9c4-6256-4ca4-9a52-f049cd821ca3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1124566 Nov 11 11:49:43.043922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f474268a-e782-4199-955c-31e6e9abc8d6 req-eb240349-9b6e-457a-a4f2-c06583d73c09 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:43.045918 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f474268a-e782-4199-955c-31e6e9abc8d6 req-eb240349-9b6e-457a-a4f2-c06583d73c09 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.2449577 Nov 11 11:49:43.061583 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-c256f643-de49-495f-8ce5-7735a0a8e101 service neutron] 10.222.0.11 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1957970 Nov 11 11:49:43.232798 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f474268a-e782-4199-955c-31e6e9abc8d6 req-e00770f4-365b-49d3-86b6-d9492386b36a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1701152 Nov 11 11:49:43.308667 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-d114844d-0a9a-4316-a1c6-f0f75905e01f service neutron] 10.222.0.11 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2206154 Nov 11 11:49:44.439670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5f696ae4-dd2f-45ea-b075-4f16515510b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:44.459657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab79c02-5611-4d25-b616-10656e1b5713 req-38e12b68-9b8d-413d-8a1f-6ebba91b094a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:44.461266 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0ab79c02-5611-4d25-b616-10656e1b5713 req-38e12b68-9b8d-413d-8a1f-6ebba91b094a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0849898 Nov 11 11:49:44.516350 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0ab79c02-5611-4d25-b616-10656e1b5713 req-5f9d5da0-c4e0-4031-898e-1ebb0506f1fa tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482478 Nov 11 11:49:44.879624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:44.919401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:45.251863 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-deaa074a-a61f-47ee-89d1-42caf4f2a419 req-7587b4fd-aa41-4131-aee1-d62d91115490 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 210 time: 0.0604069 Nov 11 11:49:45.755025 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82349dec-f9da-49cf-9cf1-b022a4cb0004 req-c5c8f2b1-ea6d-4f32-973d-6ff46c51ef80 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:45.756764 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-82349dec-f9da-49cf-9cf1-b022a4cb0004 req-c5c8f2b1-ea6d-4f32-973d-6ff46c51ef80 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0946782 Nov 11 11:49:45.817359 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-82349dec-f9da-49cf-9cf1-b022a4cb0004 req-817a2ae9-5d35-4c7e-a848-a54756bab922 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541856 Nov 11 11:49:46.446477 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d5e9bdea-cc9a-4eb7-b46a-7fc63e68236c req-a30b411f-a78a-4f28-9ca8-67349eb8c53a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 210 time: 0.0733695 Nov 11 11:49:47.096484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c85fcd6-6956-4c72-a05e-3c3569bc659a req-a520d02a-f939-4f69-849e-a99fc06e43e2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:47.098083 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9c85fcd6-6956-4c72-a05e-3c3569bc659a req-a520d02a-f939-4f69-849e-a99fc06e43e2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0987771 Nov 11 11:49:47.155889 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9c85fcd6-6956-4c72-a05e-3c3569bc659a req-ba8c9925-46fd-42a1-bf23-501946d6c0e9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511377 Nov 11 11:49:47.649827 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4138eb0-2c59-47ea-9424-15800222a7a0 req-0b39fb0d-50c9-4453-b085-16f65ab5ff3d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 210 time: 0.0514805 Nov 11 11:49:48.402984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5106d2-363d-4bf6-8543-48a6330f9b15 req-1209c870-bd3d-41e3-a375-0812fb249fd0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:48.411460 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ac5106d2-363d-4bf6-8543-48a6330f9b15 req-1209c870-bd3d-41e3-a375-0812fb249fd0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.0993638 Nov 11 11:49:48.457929 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ac5106d2-363d-4bf6-8543-48a6330f9b15 req-cf70b5dc-d9e3-4bdf-9b4c-038ca521d02f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453022 Nov 11 11:49:48.847592 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f61fefae-49b1-409c-a219-6a8ff7e92bd0 req-765533c0-0190-4c1f-bc23-66baad812b2e tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 210 time: 0.0591240 Nov 11 11:49:49.315341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-2ed833c4-b328-4f55-947a-ff9ce8a8211b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:49.317310 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-2ed833c4-b328-4f55-947a-ff9ce8a8211b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 812 time: 0.1685681 Nov 11 11:49:49.376003 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-41fe788a-53de-4815-a9bf-04288e6e8db1 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1bcfb2b970f34aa9af017e16d6e4c699 HTTP/1.1" status: 200 len: 380 time: 0.0450606 Nov 11 11:49:49.385954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'port': {'device_id': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'admin_state_up': True, 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'security_groups': ['82ca2c36-3087-406f-9689-58bdf145dcc0']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:49:49.563518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:49:49.575175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:49:49.611180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Made reservation on behalf of 1bcfb2b970f34aa9af017e16d6e4c699 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:49:49.616945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:49.838831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958c529d-e3da-43f9-bb63-7706932e16d8 req-0de1e303-b9d9-451a-a65c-6fa27173e187 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:49.840470 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-958c529d-e3da-43f9-bb63-7706932e16d8 req-0de1e303-b9d9-451a-a65c-6fa27173e187 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.2128818 Nov 11 11:49:49.894643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Allocated IP 172.20.0.4 (d5ec5e34-ac26-4927-b077-b0742eacb0fd/6e9509c6-37ce-4e40-8036-e5d45e65095d/07102d32-2428-42eb-8d6a-0dfe016bac85) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:49:49.944172 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-958c529d-e3da-43f9-bb63-7706932e16d8 req-3a2f6a9a-1589-4bf2-bccc-fdff0483d4b4 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0960987 Nov 11 11:49:50.116939 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-89f05087-12b6-4744-b7ff-5660e5e426ce req-e8657b3e-5bf4-48fa-ab65-2379fb31d676 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 210 time: 0.1009312 Nov 11 11:49:50.197499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:50.216136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Transition to ACTIVE for port object 07102d32-2428-42eb-8d6a-0dfe016bac85 will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:49:50.274737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:50.283411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9fb79ff8-aa7f-4690-b837-d2d511b9b630 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:49:50.355831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:49:50.359862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:49:50.365112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:49:50.397046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=07102d32-2428-42eb-8d6a-0dfe016bac85,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:49:50.421078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.421568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.421971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.422367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.422758 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.423175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.423572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.423970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.424382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.424743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.425133 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:49:50.431349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:49:50.494956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:50.495661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:50.554981 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-26eb1d1e-54fe-4fce-bff4-c32f2ac5fe96 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 1098 time: 0.1045065 Nov 11 11:49:50.588280 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2064242 Nov 11 11:49:50.607723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Request body: {'port': {'device_id': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:49:50.809995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-fc7690c9-11d5-4c24-9579-7c1ae3693b42 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:50.811633 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-fc7690c9-11d5-4c24-9579-7c1ae3693b42 service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.2502351 Nov 11 11:49:50.820532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:50.844614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6800c172-6b31-4f05-ab51-c9d17e341766 None None] Provisioning for port 07102d32-2428-42eb-8d6a-0dfe016bac85 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:49:50.850165 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6800c172-6b31-4f05-ab51-c9d17e341766 None None] Provisioning complete for port 07102d32-2428-42eb-8d6a-0dfe016bac85 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:49:50.850592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6800c172-6b31-4f05-ab51-c9d17e341766 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:50.905983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-6800c172-6b31-4f05-ab51-c9d17e341766 None None] Port 07102d32-2428-42eb-8d6a-0dfe016bac85 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:49:51.254173 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-c9822f07-1c88-4cf2-936c-ad5050706f9c service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 HTTP/1.1" status: 200 len: 1000 time: 0.4346979 Nov 11 11:49:51.479686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-e0131701-bb74-4e69-bc0b-2ee355d8d821 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:51.481266 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-e0131701-bb74-4e69-bc0b-2ee355d8d821 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.1400549 Nov 11 11:49:51.487785 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e152ae3d-3418-474a-9818-3878a7d623fa req-419a7651-937d-4ed6-88c1-779b4ce4fd88 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:51.489265 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e152ae3d-3418-474a-9818-3878a7d623fa req-419a7651-937d-4ed6-88c1-779b4ce4fd88 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.3757999 Nov 11 11:49:51.673984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58231f7-c656-4377-9d4d-79978c9f8efd req-3e9ff5fe-1110-4965-9a46-d71999d1f3e7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:51.674732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-f58231f7-c656-4377-9d4d-79978c9f8efd req-3e9ff5fe-1110-4965-9a46-d71999d1f3e7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Synchronizing usage tracker for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:49:51.721697 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e152ae3d-3418-474a-9818-3878a7d623fa req-bc46f37e-c765-4ef9-a80c-fbead5553ea6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2190487 Nov 11 11:49:51.742255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-f58231f7-c656-4377-9d4d-79978c9f8efd req-3e9ff5fe-1110-4965-9a46-d71999d1f3e7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Unset dirty status for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:49:51.743539 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f58231f7-c656-4377-9d4d-79978c9f8efd req-3e9ff5fe-1110-4965-9a46-d71999d1f3e7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 931 time: 0.4876504 Nov 11 11:49:51.779453 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-bae35405-c2f1-4403-8eb2-10922f0e11d5 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2884033 Nov 11 11:49:51.967069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 07102d32-2428-42eb-8d6a-0dfe016bac85 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:49:51.980231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:51.986463 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f58231f7-c656-4377-9d4d-79978c9f8efd req-d161e8f2-84a9-4ad9-9e8e-93fe12c22122 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2351406 Nov 11 11:49:52.017547 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Transition to ACTIVE for port object 07102d32-2428-42eb-8d6a-0dfe016bac85 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:49:52.034057 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-3d2e103d-9e27-4f82-8943-2e74ed18a522 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2464247 Nov 11 11:49:52.069769 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:52.088075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:49:52.284526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Pushing event updated for resources: {'Port': ['ID=07102d32-2428-42eb-8d6a-0dfe016bac85,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:49:52.296065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:49:52.395740 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3379d411-7db0-4f42-8448-b28e0d10c68d req-f9efff97-6db0-4eb2-80d5-45694a2dfae2 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3541930 Nov 11 11:49:52.432322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Attempting to bind port 07102d32-2428-42eb-8d6a-0dfe016bac85 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:49:52.432711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Attempting to bind port 07102d32-2428-42eb-8d6a-0dfe016bac85 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:49:52.433023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Attempting to bind port 07102d32-2428-42eb-8d6a-0dfe016bac85 on network d5ec5e34-ac26-4927-b077-b0742eacb0fd {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:49:52.439825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Port 07102d32-2428-42eb-8d6a-0dfe016bac85 on network d5ec5e34-ac26-4927-b077-b0742eacb0fd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:49:52.442385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Attempting to bind port 07102d32-2428-42eb-8d6a-0dfe016bac85 on network d5ec5e34-ac26-4927-b077-b0742eacb0fd {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:49:52.447265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 49, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:49:52.447653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Checking segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:49:52.448074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Bound using segment: {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:49:52.448546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Bound port: 07102d32-2428-42eb-8d6a-0dfe016bac85, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:49:52.448938 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:52.546291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] For port 07102d32-2428-42eb-8d6a-0dfe016bac85, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:49:52.550482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] For port 07102d32-2428-42eb-8d6a-0dfe016bac85, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=07102d32-2428-42eb-8d6a-0dfe016bac85,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:49:52.611365 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:52.616150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:49:52.684518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:52.686035 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] 10.222.0.60 "PUT /v2.0/ports/07102d32-2428-42eb-8d6a-0dfe016bac85 HTTP/1.1" status: 200 len: 1093 time: 2.0829043 Nov 11 11:49:52.686565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:49:52.709039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Pushing event updated for resources: {'Port': ['ID=07102d32-2428-42eb-8d6a-0dfe016bac85,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:49:52.714377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:49:52.746225 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'status': 'completed', 'code': 200} Nov 11 11:49:52.855008 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d8389f6a-3d20-4a50-ac1d-1455d026426a req-c686f115-2501-48b7-86d3-f4c7d3988473 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 1096 time: 0.0853269 Nov 11 11:49:53.092095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8389f6a-3d20-4a50-ac1d-1455d026426a req-69cdd18a-f45e-4019-8b55-4c8266d9cfab service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:53.093722 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d8389f6a-3d20-4a50-ac1d-1455d026426a req-69cdd18a-f45e-4019-8b55-4c8266d9cfab service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&shared=False HTTP/1.1" status: 200 len: 914 time: 0.2222097 Nov 11 11:49:53.104386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eea9182-9b4c-4013-8bad-953604f7b5df req-e533c59d-0a76-4ca4-82d2-e0286b928270 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:53.105960 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2eea9182-9b4c-4013-8bad-953604f7b5df req-e533c59d-0a76-4ca4-82d2-e0286b928270 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 945 time: 0.2055247 Nov 11 11:49:53.327272 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2eea9182-9b4c-4013-8bad-953604f7b5df req-76a37908-a2e1-47e4-871f-c2fbf3c4a96a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1921866 Nov 11 11:49:53.359478 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8389f6a-3d20-4a50-ac1d-1455d026426a req-3a3ce917-952c-4e79-9a84-8646e3c9a594 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:53.361059 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d8389f6a-3d20-4a50-ac1d-1455d026426a req-3a3ce917-952c-4e79-9a84-8646e3c9a594 service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.2541604 Nov 11 11:49:53.370233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-085b636a-011a-4980-a355-3abee5a26e2f req-8722ddd8-f944-45df-9a30-e0b6798dd194 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:53.376459 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-085b636a-011a-4980-a355-3abee5a26e2f req-8722ddd8-f944-45df-9a30-e0b6798dd194 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.2408855 Nov 11 11:49:53.422621 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-085b636a-011a-4980-a355-3abee5a26e2f req-fd103d68-9205-4658-8d6c-9215b87f92b3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439939 Nov 11 11:49:53.515812 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-e0e9cf27-e577-4c4d-9d85-ef5bbac081fc service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 1096 time: 0.0798051 Nov 11 11:49:53.588399 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-78b32f5d-700b-4e0f-99dc-c41962fc3137 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=07102d32-2428-42eb-8d6a-0dfe016bac85 HTTP/1.1" status: 200 len: 217 time: 0.0650501 Nov 11 11:49:53.660796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-bdebf4b2-4708-4487-b73e-70d0f9733673 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:53.662370 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-bdebf4b2-4708-4487-b73e-70d0f9733673 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.0663214 Nov 11 11:49:53.666979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:49:53.744896 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-e078f791-5267-4254-821a-8ab88f5f898d service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0754793 Nov 11 11:49:53.785956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:53.814619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:49:53.826870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:49:53.868686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:49:53.873161 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'code': 200} Nov 11 11:49:53.873762 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:49:53.896656 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-fc41508a-3bfb-4749-8a08-0348030f70b6 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1439772 Nov 11 11:49:53.947628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=8']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:49:53.951191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:49:54.253899 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f275a86a-39f1-4c19-a64c-e06251171e5a req-24fd6a74-7beb-4ce2-87f0-6da0fd9355e4 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3501899 Nov 11 11:49:54.555581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1aeb2d0-3108-4beb-bdf0-732bae6304be req-f4e24382-3c9d-4c29-a555-dbb50a144d80 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:54.557137 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1aeb2d0-3108-4beb-bdf0-732bae6304be req-f4e24382-3c9d-4c29-a555-dbb50a144d80 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0887637 Nov 11 11:49:54.658189 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e1aeb2d0-3108-4beb-bdf0-732bae6304be req-cbbac153-986d-43d7-88f2-5109fd1a57a0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0650253 Nov 11 11:49:54.678540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1eea572-6796-4642-a539-3aa34db45792 req-dc27887f-3746-40aa-b1cd-136664be39fd tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:54.680175 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c1eea572-6796-4642-a539-3aa34db45792 req-dc27887f-3746-40aa-b1cd-136664be39fd tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1220672 Nov 11 11:49:54.736039 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c1eea572-6796-4642-a539-3aa34db45792 req-4d3b333d-2418-4677-b482-a1b7b7dcf356 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469766 Nov 11 11:49:55.582792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:49:55.958609 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0f9be3-1fe4-4c07-9edb-db4dd2ee5fac req-ae740179-8ab1-4e06-9da4-a09ad4737fdd tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:55.960242 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-df0f9be3-1fe4-4c07-9edb-db4dd2ee5fac req-ae740179-8ab1-4e06-9da4-a09ad4737fdd tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0993402 Nov 11 11:49:56.009665 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-df0f9be3-1fe4-4c07-9edb-db4dd2ee5fac req-8942d628-5bd0-4156-9459-8ccce6cdb6f3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428457 Nov 11 11:49:56.657145 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-98f21563-54d5-40f3-9205-4da8f72c28ed req-4d0305cb-d4c8-4178-ae84-55434a8e731b service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0780022 Nov 11 11:49:56.991484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4412c3-dbc5-4b5f-b417-d1871a6a3b26 req-4204695c-87e0-447e-be7e-837b9f014464 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:56.993087 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5d4412c3-dbc5-4b5f-b417-d1871a6a3b26 req-4204695c-87e0-447e-be7e-837b9f014464 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0821526 Nov 11 11:49:57.034973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 38628) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:49:57.043101 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5d4412c3-dbc5-4b5f-b417-d1871a6a3b26 req-262be63b-d462-4548-b9ff-b2a63750d629 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433230 Nov 11 11:49:57.189834 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-a00c8e5b-1dd9-4be6-935e-c9a9ac215d4f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1527991 Nov 11 11:49:57.227692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958a845c-e073-4191-a523-21f87d9f57af req-ca082aa3-ec1d-425e-8fd9-cab493c44062 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:57.229469 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-958a845c-e073-4191-a523-21f87d9f57af req-ca082aa3-ec1d-425e-8fd9-cab493c44062 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0920320 Nov 11 11:49:57.278521 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-958a845c-e073-4191-a523-21f87d9f57af req-710160f8-5f06-47e6-ad06-81945470413d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431123 Nov 11 11:49:57.682642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:49:57.850981 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-168a3d67-6224-4bbf-9fc1-8b88492db83e service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87&tenant_id=49b88e3cf8f748be91f37e0b9caccf6d HTTP/1.1" status: 200 len: 1096 time: 0.0735064 Nov 11 11:49:57.953131 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-8eefe485-85ae-477b-88eb-a64440b271aa service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 1096 time: 0.0807319 Nov 11 11:49:58.092749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-b654b292-89c7-4a1c-9d3f-7239dc6fdd8f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:58.095308 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-b654b292-89c7-4a1c-9d3f-7239dc6fdd8f service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.1358511 Nov 11 11:49:58.248870 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-2d685820-0d4c-46cf-a7c4-4305b6010fa0 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 HTTP/1.1" status: 200 len: 998 time: 0.1463866 Nov 11 11:49:58.340794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753cc7ad-cd18-4b6e-8bad-3fdb95965e4b req-049ed1d8-c27f-45ab-800e-c8aa73250acf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:58.342390 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-753cc7ad-cd18-4b6e-8bad-3fdb95965e4b req-049ed1d8-c27f-45ab-800e-c8aa73250acf tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1590104 Nov 11 11:49:58.344386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-eb2591b0-c352-42b9-bd9e-b2f9f8f0e203 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:58.346069 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-eb2591b0-c352-42b9-bd9e-b2f9f8f0e203 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0907614 Nov 11 11:49:58.493839 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-753cc7ad-cd18-4b6e-8bad-3fdb95965e4b req-d483dd23-bf04-41be-91fc-57a326e07387 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1439447 Nov 11 11:49:58.529969 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-b2950339-30db-46cd-a318-325545c01cc5 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1631117 Nov 11 11:49:58.563372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2567a767-fdd6-4662-b86c-a16b1949bf27 req-7832b396-025a-4e96-a48b-32278334445b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:58.564957 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2567a767-fdd6-4662-b86c-a16b1949bf27 req-7832b396-025a-4e96-a48b-32278334445b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1536467 Nov 11 11:49:58.695069 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2567a767-fdd6-4662-b86c-a16b1949bf27 req-d4c0f3d9-d94e-4f43-b2d8-e7d336da23f5 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1231415 Nov 11 11:49:58.720507 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-8871db2f-4625-479c-a3e7-82310455fe24 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1833663 Nov 11 11:49:58.861872 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-70cfe064-ca71-41be-ad29-a9743ce3cb0a req-eec5267a-3f35-4f3c-925a-1255dc745193 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1341107 Nov 11 11:49:59.733056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d7ad31f-d8bc-4901-85d8-be491e8e3da0 req-d1f725b0-a44a-4fb0-8df9-9056ae3f0d2a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:59.735973 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2d7ad31f-d8bc-4901-85d8-be491e8e3da0 req-d1f725b0-a44a-4fb0-8df9-9056ae3f0d2a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0888805 Nov 11 11:49:59.788672 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2d7ad31f-d8bc-4901-85d8-be491e8e3da0 req-e27a2cac-3885-435b-9b22-4cdffd2aecbd tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468233 Nov 11 11:49:59.910184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc0a5d-3d47-4d13-901f-0e6287a8b945 req-86dba841-9927-4208-aa01-682715c967fe tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:49:59.911931 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-43fc0a5d-3d47-4d13-901f-0e6287a8b945 req-86dba841-9927-4208-aa01-682715c967fe tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0881298 Nov 11 11:49:59.982778 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-43fc0a5d-3d47-4d13-901f-0e6287a8b945 req-28aae7d5-6c0d-420d-acb0-182aed7d36b2 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0642371 Nov 11 11:50:01.016206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30b64c8-5247-46ca-96cc-3984ec024219 req-f6f96f34-8d12-4bf4-aec7-264bc5962dd2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:01.017875 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a30b64c8-5247-46ca-96cc-3984ec024219 req-f6f96f34-8d12-4bf4-aec7-264bc5962dd2 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0884695 Nov 11 11:50:01.085453 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a30b64c8-5247-46ca-96cc-3984ec024219 req-b1d9ec62-d7a4-40c9-b2c8-b7e49057a85a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530221 Nov 11 11:50:01.229100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868e9bea-9b55-4b17-bc91-96cc4ebb71ed req-296e2bb4-6fd4-4960-8756-950b1fa86f5b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:01.230690 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-868e9bea-9b55-4b17-bc91-96cc4ebb71ed req-296e2bb4-6fd4-4960-8756-950b1fa86f5b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0917327 Nov 11 11:50:01.287565 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-868e9bea-9b55-4b17-bc91-96cc4ebb71ed req-f612591f-910e-46df-bb28-dcbd56b015b4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497770 Nov 11 11:50:02.321685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-952c0478-2e67-4724-b998-dc2d6b49de8e req-74b74b55-1dcc-4d1a-afa8-8f01ca5581e9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:02.323462 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-952c0478-2e67-4724-b998-dc2d6b49de8e req-74b74b55-1dcc-4d1a-afa8-8f01ca5581e9 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0912433 Nov 11 11:50:02.380157 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-952c0478-2e67-4724-b998-dc2d6b49de8e req-c1e29a80-4572-46b6-9ad9-2dcc8263646a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493667 Nov 11 11:50:02.514678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e9599b3-f8ed-48e1-8b24-93dffe182a36 req-31fddfca-021c-4388-af00-18c19bf86e88 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:02.516684 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e9599b3-f8ed-48e1-8b24-93dffe182a36 req-31fddfca-021c-4388-af00-18c19bf86e88 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0911903 Nov 11 11:50:02.598278 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e9599b3-f8ed-48e1-8b24-93dffe182a36 req-3ac1d648-25ae-405e-9782-5e829f82aebd tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0674174 Nov 11 11:50:03.620098 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b57c25f-ddc8-4840-83b9-f1cc9caec248 req-1f898d64-8057-4a97-a504-b3ad158efc97 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:03.621729 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b57c25f-ddc8-4840-83b9-f1cc9caec248 req-1f898d64-8057-4a97-a504-b3ad158efc97 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0937376 Nov 11 11:50:03.684360 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b57c25f-ddc8-4840-83b9-f1cc9caec248 req-ac102ae0-7a84-4ef2-98f6-facdd148b850 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541143 Nov 11 11:50:03.816872 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404cd6cc-62e5-4720-a199-1e3252b3bfc2 req-85b7cff0-9cf9-4a74-9180-6cd628277e26 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:03.818823 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-404cd6cc-62e5-4720-a199-1e3252b3bfc2 req-85b7cff0-9cf9-4a74-9180-6cd628277e26 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0886731 Nov 11 11:50:03.877838 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-404cd6cc-62e5-4720-a199-1e3252b3bfc2 req-878bf0be-7c0d-436e-9251-2e5fb9b9f63d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509453 Nov 11 11:50:04.621778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:04.939326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2eb098-87fc-44b2-bf70-a0a13611e02a req-96b6d83f-78af-4bfd-a192-f74b2fd30cc4 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:04.941094 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ea2eb098-87fc-44b2-bf70-a0a13611e02a req-96b6d83f-78af-4bfd-a192-f74b2fd30cc4 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1085389 Nov 11 11:50:05.079316 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ea2eb098-87fc-44b2-bf70-a0a13611e02a req-e1a8ed60-5f86-4780-a598-efa7843ead66 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1315665 Nov 11 11:50:05.117650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d3124c-6366-466e-b974-d83bc671dfe8 req-124e327a-a19b-4c7a-8d69-bc28eb3daf47 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:05.119463 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-21d3124c-6366-466e-b974-d83bc671dfe8 req-124e327a-a19b-4c7a-8d69-bc28eb3daf47 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1073880 Nov 11 11:50:05.172101 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-21d3124c-6366-466e-b974-d83bc671dfe8 req-82e99437-99ae-43b5-95ff-54510ae1c420 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457101 Nov 11 11:50:06.317212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ad3dd86-565f-45bd-a3e7-5a288f590afd req-b2e31bd5-774b-4ee1-a285-3957e2f9d10d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:06.318819 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0ad3dd86-565f-45bd-a3e7-5a288f590afd req-b2e31bd5-774b-4ee1-a285-3957e2f9d10d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1032665 Nov 11 11:50:06.434255 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0ad3dd86-565f-45bd-a3e7-5a288f590afd req-3f61265e-75f4-43d2-92c9-3f720a4c6101 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1031594 Nov 11 11:50:06.459099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-356d1e74-1fd1-467d-951d-5cdccf1eb6a2 req-2929a43a-811b-4087-9b6f-a0ae12be0c64 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:06.460712 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-356d1e74-1fd1-467d-951d-5cdccf1eb6a2 req-2929a43a-811b-4087-9b6f-a0ae12be0c64 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1126719 Nov 11 11:50:06.514344 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-356d1e74-1fd1-467d-951d-5cdccf1eb6a2 req-d078618b-02df-4e1f-908b-ed3da4e49eb2 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474634 Nov 11 11:50:07.696449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a03ec9fc-1eb4-46df-b587-a60b169f7773 req-3e526b44-abbe-4288-bb5b-5387eeafe9c6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:07.698041 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a03ec9fc-1eb4-46df-b587-a60b169f7773 req-3e526b44-abbe-4288-bb5b-5387eeafe9c6 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0965507 Nov 11 11:50:07.810128 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a03ec9fc-1eb4-46df-b587-a60b169f7773 req-8038cd38-7989-4c8e-b328-d5c315d64223 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0714953 Nov 11 11:50:07.824163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed1f8cd-96ae-4fe7-9652-0f998ae9fbc5 req-d288f20d-cde1-4026-ad5b-04df714f47d6 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:07.825746 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eed1f8cd-96ae-4fe7-9652-0f998ae9fbc5 req-d288f20d-cde1-4026-ad5b-04df714f47d6 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1267533 Nov 11 11:50:07.877340 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eed1f8cd-96ae-4fe7-9652-0f998ae9fbc5 req-81ba92af-fb64-441f-a971-e5cd529bbbda tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453949 Nov 11 11:50:09.083915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c68969a-b985-49c1-b743-6464b8c2548c req-92b437f5-7db9-40e7-86c0-a751d6bf3a4f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:09.085558 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0c68969a-b985-49c1-b743-6464b8c2548c req-92b437f5-7db9-40e7-86c0-a751d6bf3a4f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1355581 Nov 11 11:50:09.152887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0c68969a-b985-49c1-b743-6464b8c2548c req-de18ab29-0a01-48c4-952c-2359f4599d7d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0603116 Nov 11 11:50:09.161052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05cc227-e9ea-460c-82d8-e71f0d33e626 req-44977d22-a9b4-452a-ad09-0196b1f8c1c8 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:09.162391 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a05cc227-e9ea-460c-82d8-e71f0d33e626 req-44977d22-a9b4-452a-ad09-0196b1f8c1c8 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1487894 Nov 11 11:50:09.211660 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a05cc227-e9ea-460c-82d8-e71f0d33e626 req-60c10887-6a0a-4293-9910-9bd69ab0d729 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427115 Nov 11 11:50:10.073441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-480d4a65-10d9-458c-aea4-f5a9981df982 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:10.457904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11649761-02ce-4d80-b251-702ce57c6535 req-90ed72b7-3476-48f3-8a38-4f56bcf3ea46 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:10.460063 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-11649761-02ce-4d80-b251-702ce57c6535 req-90ed72b7-3476-48f3-8a38-4f56bcf3ea46 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1570902 Nov 11 11:50:10.524391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b008ecbd-aeb8-4c4d-aaa2-8f26d21e8b8c req-298f2f04-7bae-497d-b3fe-9742c3de6404 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:10.526109 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b008ecbd-aeb8-4c4d-aaa2-8f26d21e8b8c req-298f2f04-7bae-497d-b3fe-9742c3de6404 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1519611 Nov 11 11:50:10.596088 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b008ecbd-aeb8-4c4d-aaa2-8f26d21e8b8c req-9f57eed2-bb93-4898-88cb-de7c6fb9537d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493975 Nov 11 11:50:10.598459 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-11649761-02ce-4d80-b251-702ce57c6535 req-6e3ddafc-8bf3-4482-a40c-ad4d6ef29d56 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1287882 Nov 11 11:50:11.285123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:11.938060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b9765a0-7107-475e-8aae-d634517a10dd req-1ad40199-d927-43a5-9d6a-465552b3c8bb tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:11.939604 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b9765a0-7107-475e-8aae-d634517a10dd req-1ad40199-d927-43a5-9d6a-465552b3c8bb tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1625245 Nov 11 11:50:11.946612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce696dd-c4bf-4cf1-961a-44e873b94839 req-962cd76d-ac63-4f0e-aeee-e768e946d959 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:11.948329 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6ce696dd-c4bf-4cf1-961a-44e873b94839 req-962cd76d-ac63-4f0e-aeee-e768e946d959 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1251493 Nov 11 11:50:12.029572 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b9765a0-7107-475e-8aae-d634517a10dd req-86534d6c-e9a8-468e-afa2-1f4afef3d883 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0802078 Nov 11 11:50:12.037499 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6ce696dd-c4bf-4cf1-961a-44e873b94839 req-b0862ae8-8d5e-4370-9a6a-50cde63e87d4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0704291 Nov 11 11:50:13.473562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6b9dfe42-f0ad-4456-88be-0fa2e6eb567f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:13.507718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:13.533253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d052afc4-f33b-4239-b45e-ed0d20d0eb99 req-72eaabc3-7983-4089-b377-6e6643a7e3de tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:13.534932 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d052afc4-f33b-4239-b45e-ed0d20d0eb99 req-72eaabc3-7983-4089-b377-6e6643a7e3de tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.3689988 Nov 11 11:50:13.553289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf30750-2613-4889-b59e-da0eb81965bd req-910d799c-5023-4791-b9ca-7961c371324f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:13.554848 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5bf30750-2613-4889-b59e-da0eb81965bd req-910d799c-5023-4791-b9ca-7961c371324f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1243784 Nov 11 11:50:13.646472 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d052afc4-f33b-4239-b45e-ed0d20d0eb99 req-f5dbdc72-870c-4ade-ae89-de76a4e0bee7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1024578 Nov 11 11:50:13.649128 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5bf30750-2613-4889-b59e-da0eb81965bd req-66de53f4-fbbf-4051-8fea-455da83f132c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0792789 Nov 11 11:50:14.673447 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:14.943501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2552245f-84e8-4ba0-a896-364b4796db72 req-90ed1a8b-3b12-469a-90f5-22f56bf4396c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:14.945092 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2552245f-84e8-4ba0-a896-364b4796db72 req-90ed1a8b-3b12-469a-90f5-22f56bf4396c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1405849 Nov 11 11:50:14.989505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291a8f6b-cfa0-45a9-9685-3838f5d11d7c req-e070bb0a-9a14-4455-a943-05cc5b9831fa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:14.991106 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-291a8f6b-cfa0-45a9-9685-3838f5d11d7c req-e070bb0a-9a14-4455-a943-05cc5b9831fa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.2135828 Nov 11 11:50:15.033385 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2552245f-84e8-4ba0-a896-364b4796db72 req-90b585cd-5f2d-49d4-97a4-92c4b77231d0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0788400 Nov 11 11:50:15.055329 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-291a8f6b-cfa0-45a9-9685-3838f5d11d7c req-a75defe8-3955-45e1-9293-37b5f0d1f47b tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0548701 Nov 11 11:50:16.325611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea55ab4-a3ba-4636-b636-a7873ee97867 req-eda93c57-fa96-4785-b16b-4a084cf04cc5 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:16.327189 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2ea55ab4-a3ba-4636-b636-a7873ee97867 req-eda93c57-fa96-4785-b16b-4a084cf04cc5 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1528950 Nov 11 11:50:16.334192 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407c1cd4-2f94-4325-811d-25ba63591e1c req-8feb514c-8479-4e03-92ae-604a92d5f342 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:16.335750 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-407c1cd4-2f94-4325-811d-25ba63591e1c req-8feb514c-8479-4e03-92ae-604a92d5f342 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1271465 Nov 11 11:50:16.418668 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2ea55ab4-a3ba-4636-b636-a7873ee97867 req-c7a7d06c-540a-4a6d-900f-21cf9f71f516 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0818527 Nov 11 11:50:16.421848 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-407c1cd4-2f94-4325-811d-25ba63591e1c req-cf3edc72-2b80-4481-a21c-db5bb4ea9f57 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0694685 Nov 11 11:50:17.706249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae567eb-9def-419a-9acf-250d60ed2c0e req-7fb76a79-29db-45a1-a793-f470ba9c3d8f tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:17.707866 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0ae567eb-9def-419a-9acf-250d60ed2c0e req-7fb76a79-29db-45a1-a793-f470ba9c3d8f tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.1578481 Nov 11 11:50:17.713792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3be7db3-449a-4bd0-a0d3-771d4e825e90 req-fec859e6-c480-4e9c-bed6-88229f844aca tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:17.715250 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d3be7db3-449a-4bd0-a0d3-771d4e825e90 req-fec859e6-c480-4e9c-bed6-88229f844aca tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1248789 Nov 11 11:50:17.788978 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0ae567eb-9def-419a-9acf-250d60ed2c0e req-971204e7-3aab-49aa-9986-50b109444db2 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0727022 Nov 11 11:50:17.796155 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d3be7db3-449a-4bd0-a0d3-771d4e825e90 req-b4c0c3cf-f939-4d00-9118-4d8dfb4f0e6d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0653045 Nov 11 11:50:19.009020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f0b4b71-dce5-4915-9ecd-35494a5df11e req-b41fec77-1377-444d-b932-abe7205b0203 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:19.010622 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5f0b4b71-dce5-4915-9ecd-35494a5df11e req-b41fec77-1377-444d-b932-abe7205b0203 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0945542 Nov 11 11:50:19.106739 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5f0b4b71-dce5-4915-9ecd-35494a5df11e req-ac185e38-8a4f-436b-b9dd-55c6391b5999 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0898910 Nov 11 11:50:19.142873 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5683f3-c25f-4301-a41f-948fce771d2b req-f37064b3-0e30-44ac-aca3-5e3fcb35a49f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:19.144516 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7f5683f3-c25f-4301-a41f-948fce771d2b req-f37064b3-0e30-44ac-aca3-5e3fcb35a49f tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1858139 Nov 11 11:50:19.194152 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7f5683f3-c25f-4301-a41f-948fce771d2b req-5102597e-7161-464d-bcd4-4f972ab1ff70 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432749 Nov 11 11:50:20.316917 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee8e330-2878-4c13-a27b-7adda035502e req-6510daf4-8c20-49ed-98c5-1dcf1a13474c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:20.318512 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1ee8e330-2878-4c13-a27b-7adda035502e req-6510daf4-8c20-49ed-98c5-1dcf1a13474c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0895045 Nov 11 11:50:20.416435 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1ee8e330-2878-4c13-a27b-7adda035502e req-e0513fba-1222-4762-a730-0e737715c3ee tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0915906 Nov 11 11:50:20.445983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b95bbf-a797-4bed-a638-e6556ddcb875 req-5f5ab0e7-baea-4763-a8a4-a4f7c6a84385 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:20.447617 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d9b95bbf-a797-4bed-a638-e6556ddcb875 req-5f5ab0e7-baea-4763-a8a4-a4f7c6a84385 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1077278 Nov 11 11:50:20.507092 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d9b95bbf-a797-4bed-a638-e6556ddcb875 req-8804b638-8f1b-4bcf-a10e-132b6496df3e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0526297 Nov 11 11:50:21.638941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1267cced-7ef8-418d-97fa-100f5296c9a0 req-39d08941-8274-4e55-b0f6-047034bdd938 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:21.645610 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1267cced-7ef8-418d-97fa-100f5296c9a0 req-39d08941-8274-4e55-b0f6-047034bdd938 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0965943 Nov 11 11:50:21.761450 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1267cced-7ef8-418d-97fa-100f5296c9a0 req-f0601c72-e2d0-405f-8720-89fd6ccab705 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1126955 Nov 11 11:50:21.835081 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2ed880d-629e-4ad9-99e3-c78933110206 req-bac819c9-fa18-461d-b59d-08e0ea03f33d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:21.838532 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c2ed880d-629e-4ad9-99e3-c78933110206 req-bac819c9-fa18-461d-b59d-08e0ea03f33d tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.1877046 Nov 11 11:50:21.906277 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c2ed880d-629e-4ad9-99e3-c78933110206 req-02851705-65a3-45a3-8b0e-683d3b8d2f15 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0614851 Nov 11 11:50:21.909498 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-a9cedc56-9640-48db-8cf2-02a7218177c3 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 1096 time: 0.1470933 Nov 11 11:50:22.084276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-c05e48f5-dae4-42d8-be30-e9efaa48763e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:22.085792 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-c05e48f5-dae4-42d8-be30-e9efaa48763e service neutron] 10.222.0.60 "GET /v2.0/networks?id=95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 200 len: 918 time: 0.1519222 Nov 11 11:50:22.198518 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-25782953-d2c9-481c-bef1-b4e7b58aa5dd service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 HTTP/1.1" status: 200 len: 998 time: 0.1050112 Nov 11 11:50:22.269676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-33da7f36-1bf2-461f-a94b-cbbca1a5cdd6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:22.271270 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-33da7f36-1bf2-461f-a94b-cbbca1a5cdd6 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 200 len: 855 time: 0.0643344 Nov 11 11:50:22.355886 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-9f923728-ca9c-487a-bdf0-7ee1c38d9821 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=95fd47ac-3c3a-4852-88d6-8eed6cc12159&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0775323 Nov 11 11:50:22.500505 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-296e56f5-7d4b-4a4d-a6ea-c2fba4c20278 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1374142 Nov 11 11:50:22.652202 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-427d824e-5b33-4aa8-8687-e4f13bf1df2b req-c7287e2c-63cb-4a79-a372-51aae0056bd0 service neutron] 10.222.0.60 "GET /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1454268 Nov 11 11:50:22.973780 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b5a2bf-a227-48d6-8953-1d76b6bb0cdb req-a20db6c0-96ec-46b4-8041-4984c73b7caa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:22.975469 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9b5a2bf-a227-48d6-8953-1d76b6bb0cdb req-a20db6c0-96ec-46b4-8041-4984c73b7caa tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 943 time: 0.0865569 Nov 11 11:50:23.030603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9b5a2bf-a227-48d6-8953-1d76b6bb0cdb req-31f530f6-c680-4efa-8bf0-7570dcdee8dc tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424881 Nov 11 11:50:23.244613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ade3c39-59d9-4c3c-b083-671d1ea3a421 req-abb4bed3-64ed-48af-bd12-081d60b8a424 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:23.246235 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3ade3c39-59d9-4c3c-b083-671d1ea3a421 req-abb4bed3-64ed-48af-bd12-081d60b8a424 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0911558 Nov 11 11:50:23.300719 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3ade3c39-59d9-4c3c-b083-671d1ea3a421 req-b433ccaa-b13d-422a-8e55-af1b7d1d97cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470498 Nov 11 11:50:23.816360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 07102d32-2428-42eb-8d6a-0dfe016bac85 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:50:23.967096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 07102d32-2428-42eb-8d6a-0dfe016bac85, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=07102d32-2428-42eb-8d6a-0dfe016bac85,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:23.983825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'port_id': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'mac_address': 'fa:16:3e:9a:a2:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1015, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:50:24.043641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:24.063788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 07102d32-2428-42eb-8d6a-0dfe016bac85 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:50:24.079473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 07102d32-2428-42eb-8d6a-0dfe016bac85, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=07102d32-2428-42eb-8d6a-0dfe016bac85,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:24.107307 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:24.110765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:24.175772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=07102d32-2428-42eb-8d6a-0dfe016bac85,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:24.179172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:24.245188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22487a76-1586-482a-a1b4-2b13e5bfe3a7 req-b3587ce9-96c5-4458-95d4-71c5b7a91a78 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:24.246778 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-22487a76-1586-482a-a1b4-2b13e5bfe3a7 req-b3587ce9-96c5-4458-95d4-71c5b7a91a78 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 944 time: 0.0825520 Nov 11 11:50:24.298977 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-22487a76-1586-482a-a1b4-2b13e5bfe3a7 req-8f7f6e76-1108-4e4c-bf2d-da120ac57d80 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453761 Nov 11 11:50:24.524419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bfd3e64-a26c-4005-8ab6-2691141e2f2f req-030957bb-89ba-4971-8f13-b45c4ae59d51 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:24.526013 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5bfd3e64-a26c-4005-8ab6-2691141e2f2f req-030957bb-89ba-4971-8f13-b45c4ae59d51 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0839245 Nov 11 11:50:24.576285 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5bfd3e64-a26c-4005-8ab6-2691141e2f2f req-6e0faac5-5f48-4464-a895-3eb768101d29 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431538 Nov 11 11:50:24.650864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['07102d32-2428-42eb-8d6a-0dfe016bac85'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:50:25.518319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207dbb82-6d7c-4c0d-bcb6-fa0e20e3a804 req-b81c0624-e3d6-41d9-b79a-cb04e75dbdc4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:25.519895 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-207dbb82-6d7c-4c0d-bcb6-fa0e20e3a804 req-b81c0624-e3d6-41d9-b79a-cb04e75dbdc4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 944 time: 0.0931361 Nov 11 11:50:25.569432 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-207dbb82-6d7c-4c0d-bcb6-fa0e20e3a804 req-a0bf2477-ef02-44c0-aa75-6af1155e9d73 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432596 Nov 11 11:50:25.799963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467c4101-35e2-4192-9d53-b68702ee61fc req-a6a04fde-989d-47cb-9fe3-780d48615689 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:25.801533 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-467c4101-35e2-4192-9d53-b68702ee61fc req-a6a04fde-989d-47cb-9fe3-780d48615689 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 943 time: 0.0842707 Nov 11 11:50:25.823055 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:50:25.825577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 07102d32-2428-42eb-8d6a-0dfe016bac85 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:50:25.854465 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-467c4101-35e2-4192-9d53-b68702ee61fc req-c4361818-917a-41c7-b0a7-a01c313bcf71 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466094 Nov 11 11:50:26.030463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 07102d32-2428-42eb-8d6a-0dfe016bac85 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:50:26.035648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:26.046256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 07102d32-2428-42eb-8d6a-0dfe016bac85 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:50:26.047066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:26.086088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'port_id': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'mac_address': 'fa:16:3e:d8:07:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1022, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:50:26.167267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:26.215496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:50:26.253032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:26.255931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:26.285381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:50:26.301521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 07102d32-2428-42eb-8d6a-0dfe016bac85, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=07102d32-2428-42eb-8d6a-0dfe016bac85,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:26.305015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:26.312732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:26.369644 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'code': 200} Nov 11 11:50:26.383469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:26.417226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=9']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:26.421307 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:26.421825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.033s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:26.516520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=07102d32-2428-42eb-8d6a-0dfe016bac85,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:26.529921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:26.691645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:50:26.845497 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8f9d2f6e-4c32-45b6-b009-d9069b94ca3a req-91afaf80-4e72-4444-9107-8796264e44ab service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 1098 time: 0.1969743 Nov 11 11:50:26.851700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b868582-f777-4575-a52c-ccd03a86ec22 req-a1ff894b-bc7d-4599-abf3-f8a210fc8b49 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:26.853369 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b868582-f777-4575-a52c-ccd03a86ec22 req-a1ff894b-bc7d-4599-abf3-f8a210fc8b49 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 945 time: 0.1321130 Nov 11 11:50:26.977342 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b868582-f777-4575-a52c-ccd03a86ec22 req-42e78de9-2416-431e-aedd-ae514d53caa2 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1162839 Nov 11 11:50:26.981357 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8f9d2f6e-4c32-45b6-b009-d9069b94ca3a req-3f42780c-1e06-4642-9f4b-fc238451f5f1 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1150367 Nov 11 11:50:27.118626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7946afce-d298-48eb-9fcb-09aedf88502d req-336639f6-4d42-44f4-9c63-3153fded88ea tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:27.120326 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7946afce-d298-48eb-9fcb-09aedf88502d req-336639f6-4d42-44f4-9c63-3153fded88ea tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 944 time: 0.0958557 Nov 11 11:50:27.169356 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7946afce-d298-48eb-9fcb-09aedf88502d req-09ec32b4-0755-4cb5-a270-f6ae349c675e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427630 Nov 11 11:50:28.208524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4e50a5f-88fb-4e9e-a4e3-9bae9cb7f331 req-3ca3db24-b1c0-426c-84b3-0f79c793987a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:28.211511 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e4e50a5f-88fb-4e9e-a4e3-9bae9cb7f331 req-3ca3db24-b1c0-426c-84b3-0f79c793987a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 945 time: 0.0970936 Nov 11 11:50:28.268391 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e4e50a5f-88fb-4e9e-a4e3-9bae9cb7f331 req-3165b63c-ba41-4ab5-92d3-48d02c2aec8d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510802 Nov 11 11:50:28.409522 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d555553-a17a-4fe8-9426-0972448f9dfa req-677236d1-2342-412f-9705-f619e911e7b0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:28.411239 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4d555553-a17a-4fe8-9426-0972448f9dfa req-677236d1-2342-412f-9705-f619e911e7b0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 944 time: 0.0889037 Nov 11 11:50:28.468211 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4d555553-a17a-4fe8-9426-0972448f9dfa req-755281b8-941d-4bfe-8893-9ca2b3e11954 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447464 Nov 11 11:50:29.490523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c38884c-e2d2-44da-8dac-68d63267ac11 req-849a1a15-5b58-4b2c-815a-6d37e6699ab4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:29.492255 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3c38884c-e2d2-44da-8dac-68d63267ac11 req-849a1a15-5b58-4b2c-815a-6d37e6699ab4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 945 time: 0.0965044 Nov 11 11:50:29.549678 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3c38884c-e2d2-44da-8dac-68d63267ac11 req-86b8f195-1e7c-4ebd-9bc4-783c4531f93f tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500424 Nov 11 11:50:29.709343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-804c4fe6-b9f4-4194-b425-c5469eb52009 req-05629cca-031f-48c8-b694-c0d4edb269e7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:29.711027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-804c4fe6-b9f4-4194-b425-c5469eb52009 req-05629cca-031f-48c8-b694-c0d4edb269e7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 944 time: 0.0924823 Nov 11 11:50:29.767683 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-804c4fe6-b9f4-4194-b425-c5469eb52009 req-11fb9778-96aa-4b05-8f8b-58689439598a tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493670 Nov 11 11:50:29.830410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:50:29.864629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb54c9d-b7f5-4709-b34e-fd61215b4853 req-f91ce8c0-c7ff-44bd-a801-817f2d7f612a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:29.866719 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-afb54c9d-b7f5-4709-b34e-fd61215b4853 req-f91ce8c0-c7ff-44bd-a801-817f2d7f612a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 945 time: 0.0840509 Nov 11 11:50:29.906744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:50:29.907357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:29.920257 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-afb54c9d-b7f5-4709-b34e-fd61215b4853 req-a8289861-c069-4f9c-9d61-509aa5e1bef6 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463119 Nov 11 11:50:29.949910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 38872) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:30.193082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a6d1db57-5815-450a-9352-664e472619e2 tempest-TestVolumeBootPattern-1492948392 tempest-TestVolumeBootPattern-1492948392-project-admin] Synchronizing usage tracker for tenant:cfdc6b30588547c7b66704fb3a697c2e on resource:port {{(pid=88328) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:50:30.193571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:30.223335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:50:30.234494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:30.238736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a6d1db57-5815-450a-9352-664e472619e2 tempest-TestVolumeBootPattern-1492948392 tempest-TestVolumeBootPattern-1492948392-project-admin] Unset dirty status for tenant:cfdc6b30588547c7b66704fb3a697c2e on resource:port {{(pid=88328) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:50:30.241383 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a6d1db57-5815-450a-9352-664e472619e2 tempest-TestVolumeBootPattern-1492948392 tempest-TestVolumeBootPattern-1492948392-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 1093 time: 0.2898510 Nov 11 11:50:30.248290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 38882) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:30.253265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'port_id': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address': '172.20.0.4'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:50:30.259903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:50:30.265541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Usage tracker for resource:floatingip and tenant:1bcfb2b970f34aa9af017e16d6e4c699 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:50:30.267299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:30.269218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:50:30.270065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:30.281385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:50:30.306331 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'code': 200} Nov 11 11:50:30.332392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:30.351716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=10']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:30.361753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.362144 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.362533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.362918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.363335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.363716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.364093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.364469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.364846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.365214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.365586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:30.369929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:30.374985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eff35fc-2f1d-42b1-99ae-b247e7d6addc req-01293322-cd06-4774-a268-9cc655747cb0 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:30.385436 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5eff35fc-2f1d-42b1-99ae-b247e7d6addc req-01293322-cd06-4774-a268-9cc655747cb0 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 945 time: 0.1028776 Nov 11 11:50:30.432013 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5eff35fc-2f1d-42b1-99ae-b247e7d6addc req-c5c3afbe-351f-4dbd-bda4-8bd8c4bbc07d tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458121 Nov 11 11:50:30.512481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:30.655845 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1bdecaa5-c4dc-4317-86c1-dd779e7acca8 req-5c7561d8-d58a-4ee0-86fa-caf4734d7176 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 1099 time: 0.0817916 Nov 11 11:50:30.672784 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Allocated IP 172.27.3.221 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/40b0be19-b0ec-43d7-84d8-049462033b98) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:50:30.704465 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1bdecaa5-c4dc-4317-86c1-dd779e7acca8 req-5828e226-6b5e-4fea-9094-1f0e846959da service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420833 Nov 11 11:50:30.836523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:30.897407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:30.903981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:30.969361 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:50:30.977827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:50:30.980743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:50:31.005125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99669717-6cdb-4322-92fb-c30f42ffa22e req-2a45fa2c-525f-4269-9364-dd9cbf993677 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:31.006873 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-99669717-6cdb-4322-92fb-c30f42ffa22e req-2a45fa2c-525f-4269-9364-dd9cbf993677 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 946 time: 0.0976737 Nov 11 11:50:31.021520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=40b0be19-b0ec-43d7-84d8-049462033b98,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:31.043057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.043498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.043904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.044311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.044717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.045653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.046058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.055514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.056362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.056868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.057201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:31.060146 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-99669717-6cdb-4322-92fb-c30f42ffa22e req-149dbd23-485a-4dd2-ac33-cc920c461af3 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456491 Nov 11 11:50:31.064253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:31.574704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:31.674277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:31.684119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08bb1f90-0d1d-4d22-94d8-1079addc4180 req-661fd7cd-5e86-4354-a7b5-cd769dfb3527 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:31.685912 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-08bb1f90-0d1d-4d22-94d8-1079addc4180 req-661fd7cd-5e86-4354-a7b5-cd769dfb3527 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 945 time: 0.0983679 Nov 11 11:50:31.746498 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-08bb1f90-0d1d-4d22-94d8-1079addc4180 req-ed231bea-2a56-4795-8bf0-36d651171b1e tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0530193 Nov 11 11:50:32.164358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:32.192548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:32.197698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-21c3ab1f-8c43-4882-af75-83c910a64872 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:32.318758 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event updated for resources: {'Port': ['ID=40b0be19-b0ec-43d7-84d8-049462033b98,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:32.321926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:32.347553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:32.552837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b2d2ce1-80ef-40a5-abe0-c04ade89b242 req-21f65bdf-3041-41f4-be4f-33484589d6f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:32.561302 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7b2d2ce1-80ef-40a5-abe0-c04ade89b242 req-21f65bdf-3041-41f4-be4f-33484589d6f7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 946 time: 0.3417718 Nov 11 11:50:32.567643 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Floating IP 5b4820f1-5f3a-4572-ab44-5eeb19c2c467 associated. External IP: 172.27.3.221, port: 07102d32-2428-42eb-8d6a-0dfe016bac85. Nov 11 11:50:32.594796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:50:32.611727 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7b2d2ce1-80ef-40a5-abe0-c04ade89b242 req-9629e8b2-bc27-4710-97e9-c5b4d64c18e8 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493240 Nov 11 11:50:32.769970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e654b1d-b418-425a-963c-648d7665df8f req-9fa7b0d2-e72d-45b2-827b-afc5fa7418cc tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:32.771568 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7e654b1d-b418-425a-963c-648d7665df8f req-9fa7b0d2-e72d-45b2-827b-afc5fa7418cc tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 945 time: 0.0944521 Nov 11 11:50:32.848204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Deleting port 3ce43dc3-653a-4984-859e-a22653f29d63 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:50:32.848590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:33.022435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Router e7a84a32-cf44-4d0e-908d-7569d000b45d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:50:33.137876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25c1d1e9-44d6-4751-a00f-d7687fc69c21 req-a45bc88c-b148-43df-b404-ff0f9732a3a6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:33.139946 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-25c1d1e9-44d6-4751-a00f-d7687fc69c21 req-a45bc88c-b148-43df-b404-ff0f9732a3a6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 945 time: 0.2474408 Nov 11 11:50:33.230289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] For port 3ce43dc3-653a-4984-859e-a22653f29d63, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=3ce43dc3-653a-4984-859e-a22653f29d63,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:33.230695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:33.240977 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-25c1d1e9-44d6-4751-a00f-d7687fc69c21 req-d43f701a-0ff8-453b-a938-ce3855103013 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups?id=b1806054-df1a-4278-a1e2-169d2cc86ffa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0924675 Nov 11 11:50:33.246875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:50:33.260471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:50:33.275090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:50:33.277727 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:50:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:33.375751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:33.434248 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.1880367 Nov 11 11:50:33.434841 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:50:33.495245 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'status': 'completed', 'code': 200} Nov 11 11:50:33.502320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:50:33.592745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:33.593176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:33.593577 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Floating IP b20009a1-3179-46c7-8133-9dc4410aa0b6 disassociated. External IP: 172.27.3.151, port: 3ce43dc3-653a-4984-859e-a22653f29d63. Nov 11 11:50:33.593930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Calling delete_port for 3ce43dc3-653a-4984-859e-a22653f29d63 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:50:33.695480 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-09fc943d-351d-4c64-8fdd-8878f4d16001 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 1098 time: 0.1708982 Nov 11 11:50:33.896604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-621536bf-c8b8-4a10-bb7c-09d26eb94d14 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:33.898194 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-621536bf-c8b8-4a10-bb7c-09d26eb94d14 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 914 time: 0.1958694 Nov 11 11:50:33.916247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '5b4820f1-5f3a-4572-ab44-5eeb19c2c467', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.221', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:9a:a2:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:50:31Z', 'updated_at': '2021-11-11T11:50:31Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}, {'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:27Z', 'revision_number': 1, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:33.920450 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:50:33.932717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:50:33.933379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:50:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:33.997244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:34.012112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-198f958f-02b2-4cc7-a72b-163c2e721689 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:34.069146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event deleted for resources: {'Port': ['ID=3ce43dc3-653a-4984-859e-a22653f29d63,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:34.076671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:34.132783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:50:34.178285 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-5c5e09f7-4f4b-4afa-be0b-721afd62a1d0 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=07102d32-2428-42eb-8d6a-0dfe016bac85 HTTP/1.1" status: 200 len: 999 time: 0.2387092 Nov 11 11:50:34.263093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76402ea-98d1-43c7-8796-dce98f15d009 req-76c5833a-a3d5-4fd0-8d85-3a39e1ddddee tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:34.264707 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d76402ea-98d1-43c7-8796-dce98f15d009 req-76c5833a-a3d5-4fd0-8d85-3a39e1ddddee tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 946 time: 0.3638983 Nov 11 11:50:34.301342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-6b045a11-2300-4eec-a973-27ac92915dd8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:50:34.302890 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-6b045a11-2300-4eec-a973-27ac92915dd8 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.1115007 Nov 11 11:50:34.442988 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d76402ea-98d1-43c7-8796-dce98f15d009 req-19e62fa0-c221-43a7-b01d-52fef3a39697 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1704407 Nov 11 11:50:34.499712 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eb92e08a-fffb-4dd3-8f9b-51010b8839ee req-f0551db6-b75b-41c0-a96b-1928cc941392 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 210 time: 0.0644035 Nov 11 11:50:34.532589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '5b4820f1-5f3a-4572-ab44-5eeb19c2c467', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.221', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:9a:a2:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:50:31Z', 'updated_at': '2021-11-11T11:50:31Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}, {'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:27Z', 'revision_number': 1, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:34.537419 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-419b16ea-f4ef-460f-96f0-0c63b21c9272 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2270525 Nov 11 11:50:34.539901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a03b4c5d-205e-4990-89d8-8fabb4a3f733 None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '5b4820f1-5f3a-4572-ab44-5eeb19c2c467', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.221', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:9a:a2:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:50:31Z', 'updated_at': '2021-11-11T11:50:31Z', 'revision_number': 0, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}, {'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:27Z', 'revision_number': 1, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:50:34.562131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-173ee9c7-8349-463b-9259-0501adb35999 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:50:34.563354 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-173ee9c7-8349-463b-9259-0501adb35999 service neutron] 10.222.0.60 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.0086188 Nov 11 11:50:34.638601 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:34.888273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-669dd6a2-cf0c-4993-833f-b0eceb5ac554 None None] New status for floating IP 5b4820f1-5f3a-4572-ab44-5eeb19c2c467: ACTIVE {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:50:34.915543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Router bf5e2202-8700-46f0-9f7b-d7820ecb5663 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:50:35.008506 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-711a3e0e-c87a-4d5d-9e00-7f6c392cfde3 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4339664 Nov 11 11:50:35.238311 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-825fb611-858e-4fbc-a35d-86d7e31b2e57 req-d581c195-076c-442b-b43d-2b1186294094 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2201431 Nov 11 11:50:35.285623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:50:35.296780 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] Sync routers for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:50:35.309764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:50:35.310446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:50:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:35.363512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] No DVR routers for this DVR port 3ce43dc3-653a-4984-859e-a22653f29d63 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:50:35.366228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:35.369481 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'name': 'network-vif-deleted', 'tag': '3ce43dc3-653a-4984-859e-a22653f29d63'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:50:35.410902 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7e654b1d-b418-425a-963c-648d7665df8f req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.60 "DELETE /v2.0/ports/3ce43dc3-653a-4984-859e-a22653f29d63 HTTP/1.1" status: 204 len: 173 time: 2.6343238 Nov 11 11:50:35.431673 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f', 'name': 'network-vif-deleted', 'tag': '3ce43dc3-653a-4984-859e-a22653f29d63', 'status': 'completed', 'code': 200} Nov 11 11:50:35.503116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:50:35.728902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b6d643f9-4b22-463f-a243-16a001c35c24 req-97061719-b02a-4990-8f82-c89daf9c5fbe tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Synchronizing usage tracker for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:50:35.775771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b6d643f9-4b22-463f-a243-16a001c35c24 req-97061719-b02a-4990-8f82-c89daf9c5fbe tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Unset dirty status for tenant:307ee8e0c17a4e1ebce8db1a0c8ca6be on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:50:35.777061 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b6d643f9-4b22-463f-a243-16a001c35c24 req-97061719-b02a-4990-8f82-c89daf9c5fbe tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/ports?device_id=c2eec9c0-2a67-4bd2-9be5-08fe368e0c5f HTTP/1.1" status: 200 len: 210 time: 0.0986757 Nov 11 11:50:35.987635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:35.991755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] Checking router: bf5e2202-8700-46f0-9f7b-d7820ecb5663 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:50:36.003631 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:50:36.004347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:50:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:36.195801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:50:36.538431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:36.542781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92bec2fe-dd26-4f68-a2db-2197ab482780 None None] The sync data for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi is: [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:40:19Z', 'revision_number': 4, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '607fbd21-5858-4f98-ac2d-35c35e60c6e7', 'name': '', 'network_id': '6f90028e-6513-4ec3-884d-7830777c7626', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'mac_address': 'fa:16:3e:ce:f1:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:18Z', 'updated_at': '2021-11-11T11:40:35Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'subnets': [{'id': 'f175d5dc-0139-4051-bd21-8da204b3ae78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:50:37.009389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9c52aa8-6e5c-408d-90dc-52c8b145bfd6 None None] New status for floating IP b20009a1-3179-46c7-8133-9dc4410aa0b6: DOWN {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:50:37.871257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 3ce43dc3-653a-4984-859e-a22653f29d63 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:50:37.905763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 3ce43dc3-653a-4984-859e-a22653f29d63 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:50:37.906155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 3ce43dc3-653a-4984-859e-a22653f29d63 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:50:37.966185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 38950) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:38.045333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-622a7ac5-f2aa-4791-89f6-f5b5f261be35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:38.078664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-622a7ac5-f2aa-4791-89f6-f5b5f261be35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:38.152963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-622a7ac5-f2aa-4791-89f6-f5b5f261be35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:38.159009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-140b6551-007d-4643-ac09-56cbfe9e09ab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:38.175705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-622a7ac5-f2aa-4791-89f6-f5b5f261be35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1806054-df1a-4278-a1e2-169d2cc86ffa,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:38.179704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-622a7ac5-f2aa-4791-89f6-f5b5f261be35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:38.183417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-622a7ac5-f2aa-4791-89f6-f5b5f261be35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:38.184675 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-622a7ac5-f2aa-4791-89f6-f5b5f261be35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "DELETE /v2.0/security-groups/b1806054-df1a-4278-a1e2-169d2cc86ffa HTTP/1.1" status: 204 len: 168 time: 0.2167158 Nov 11 11:50:38.187535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 38954) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:38.205780 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.v2.resource [None req-8bc8bced-6875-4064-8e5c-37aa3f4f215b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] show failed (client error): The resource could not be found. Nov 11 11:50:38.206887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8bc8bced-6875-4064-8e5c-37aa3f4f215b tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "GET /v2.0/security-groups/b1806054-df1a-4278-a1e2-169d2cc86ffa HTTP/1.1" status: 404 len: 347 time: 0.0183699 Nov 11 11:50:38.210218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 38958) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:38.374987 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Deleting port 868d3ff5-7a7e-4887-b867-c468dab9561a {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:50:38.375390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:38.550912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:38.551304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:38.677688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Calling delete_port for 868d3ff5-7a7e-4887-b867-c468dab9561a owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:50:38.907207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:38.912415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:38.957512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Pushing event deleted for resources: {'Port': ['ID=868d3ff5-7a7e-4887-b867-c468dab9561a,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:38.961393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:39.064597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks [] for floatingip, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:39.096747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:39.098511 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] 10.222.0.11 "DELETE /v2.0/floatingips/b20009a1-3179-46c7-8133-9dc4410aa0b6 HTTP/1.1" status: 204 len: 168 time: 0.8869843 Nov 11 11:50:40.016115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-78caf484-1579-4d00-b0a9-d986d02c94eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:41.284201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:43.418047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 38990) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:43.461345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-86e6fa5b-f48f-4253-b73b-fba33583fc6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:43.495532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:43.980887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:44.623290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Deleting port 607fbd21-5858-4f98-ac2d-35c35e60c6e7 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:50:44.623895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:44.667126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:44.813017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] For port 607fbd21-5858-4f98-ac2d-35c35e60c6e7, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=607fbd21-5858-4f98-ac2d-35c35e60c6e7,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:44.813415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:44.945828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Calling delete_port for 607fbd21-5858-4f98-ac2d-35c35e60c6e7 owned by network:router_interface {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:50:45.221249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:45.225939 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4acec2d3-5a01-441a-a4e3-fc0f93c5025b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:45.266253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Pushing event deleted for resources: {'Port': ['ID=607fbd21-5858-4f98-ac2d-35c35e60c6e7,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:45.269979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:45.565761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:46.374412 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Router bf5e2202-8700-46f0-9f7b-d7820ecb5663 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:50:46.585622 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:50:46.596218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] Sync routers for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:50:46.599523 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] 10.222.0.11 "PUT /v2.0/routers/bf5e2202-8700-46f0-9f7b-d7820ecb5663/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1802506 Nov 11 11:50:46.602137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 38996) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:46.609726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:50:46.610401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:50:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:46.797651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:50:46.809549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks [] for router, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:47.025695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:47.066465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Deleting port 00c95897-698a-4236-ab83-98868d5cdc26 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:50:47.066896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:47.102779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': '00c95897-698a-4236-ab83-98868d5cdc26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:50:45Z', 'revision_number': 5, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port': {'id': '00c95897-698a-4236-ab83-98868d5cdc26', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:c0:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:12Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:47.106880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] Checking router: bf5e2202-8700-46f0-9f7b-d7820ecb5663 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:50:47.118054 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] Routers {'bf5e2202-8700-46f0-9f7b-d7820ecb5663'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:50:47.118716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:50:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:47.247536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] For port 00c95897-698a-4236-ab83-98868d5cdc26, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=00c95897-698a-4236-ab83-98868d5cdc26,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:47.247943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:47.273783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] Set router bf5e2202-8700-46f0-9f7b-d7820ecb5663 gateway port host: None {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:50:47.373773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Calling delete_port for 00c95897-698a-4236-ab83-98868d5cdc26 owned by network:router_gateway {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:50:47.386080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:50:47Z', 'revision_number': 6, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port_host': None}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:47.390847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e07a0fb-6eee-4404-9a40-cb666222119d None None] The sync data for ids ['bf5e2202-8700-46f0-9f7b-d7820ecb5663'] in dv-cinder-817417-1-iscsi is: [{'id': 'bf5e2202-8700-46f0-9f7b-d7820ecb5663', 'name': 'tempest-AttachVolumeTestJSON-2030184733-router', 'tenant_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:11Z', 'updated_at': '2021-11-11T11:50:47Z', 'revision_number': 6, 'project_id': '307ee8e0c17a4e1ebce8db1a0c8ca6be', 'gw_port_host': None}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:50:47.674929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:47.681861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-110386ef-cace-4105-9a49-7112c79f7abb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:47.725598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Pushing event deleted for resources: {'Port': ['ID=00c95897-698a-4236-ab83-98868d5cdc26,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:47.728203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:47.965661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:48.448542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:48.453557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:48.666556 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:48.667014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Fanout notify agent at l3_agent the message router_deleted on router bf5e2202-8700-46f0-9f7b-d7820ecb5663 {{(pid=88329) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 11:50:48.681123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Notify callbacks [] for router, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:48.682494 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] 10.222.0.11 "DELETE /v2.0/routers/bf5e2202-8700-46f0-9f7b-d7820ecb5663 HTTP/1.1" status: 204 len: 168 time: 2.0792274 Nov 11 11:50:48.685093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39002) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:48.717422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 00c95897-698a-4236-ab83-98868d5cdc26 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:50:48.753543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 00c95897-698a-4236-ab83-98868d5cdc26 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:50:48.753920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 00c95897-698a-4236-ab83-98868d5cdc26 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:50:48.754449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 607fbd21-5858-4f98-ac2d-35c35e60c6e7 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:50:48.765208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Deleting subnet f175d5dc-0139-4051-bd21-8da204b3ae78 {{(pid=88329) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:50:48.768878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:48.788240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 607fbd21-5858-4f98-ac2d-35c35e60c6e7 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:50:48.788635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 607fbd21-5858-4f98-ac2d-35c35e60c6e7 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:50:48.821378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852055773'] for subnet, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:48.943819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.204095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852055754', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036852017038'] for subnet, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.209228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-91750046-d4ba-406f-a0d3-1b61ad8ff753 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:49.250227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f175d5dc-0139-4051-bd21-8da204b3ae78,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:49.254646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:49.255782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.260695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef11f610-9b0e-441b-9532-ed9651e96426 None None] Network 6f90028e-6513-4ec3-884d-7830777c7626 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:50:49.261840 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/f175d5dc-0139-4051-bd21-8da204b3ae78 HTTP/1.1" status: 204 len: 168 time: 0.5756483 Nov 11 11:50:49.264625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39006) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:49.383693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.396356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Deleting port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:50:49.396739 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.616268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] For port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:49.616888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.675577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] DHCP port deletion for 6f90028e-6513-4ec3-884d-7830777c7626 request from dv-cinder-817417-1-iscsi {{(pid=88330) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:247}} Nov 11 11:50:49.680330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] Deleting port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:50:49.680731 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.749810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Calling delete_port for f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e owned by network:dhcp {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:50:49.878142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.882893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fae4abe5-fff6-4785-94d9-f4c7cd93021c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:49.888471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] For port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e,segment=NetworkSegment(42c776fe-664f-4fda-a846-8702497a4e04),segment_id=42c776fe-664f-4fda-a846-8702497a4e04)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:50:49.888913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:49.926514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Pushing event deleted for resources: {'Port': ['ID=f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:49.929102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:49.932777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] No DVR routers for this DVR port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e on host dv-cinder-817417-1-iscsi {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:50:50.014378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] Calling delete_port for f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e owned by network:dhcp {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:50:50.057097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:50.084228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f90028e-6513-4ec3-884d-7830777c7626']}} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:50.097169 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '42c776fe-664f-4fda-a846-8702497a4e04') {'for_net_delete': True} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:50.097507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '42c776fe-664f-4fda-a846-8702497a4e04') {} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:50:50.109991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2720042'] for segment, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:50.151467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:50:50.151795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:50:50.181052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:50.188921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Releasing vlan 1007 on physical network physnet1 to pool {{(pid=88329) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:50:50.189366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2720660'] for segment, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:50:50.207383 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:50:50.449249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:50.453596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0dffda9b-2923-47ee-846e-6632da1c1447 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:50.467572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:50.478690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Pushing event deleted for resources: {'Network': ['ID=6f90028e-6513-4ec3-884d-7830777c7626,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:50.495036 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.495469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.495873 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.496266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.496656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.497043 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.497477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.497819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.498201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.498586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.499495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:50:50.502647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:50.518648 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] 10.222.0.11 "DELETE /v2.0/networks/6f90028e-6513-4ec3-884d-7830777c7626 HTTP/1.1" status: 204 len: 168 time: 1.2528977 Nov 11 11:50:50.653302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] Deleting port f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:50:50.653761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:50.717363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:50:50.758769 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-702c96d5-3d70-4b10-a3b2-f95831f30e00 None None] The port 'f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e' was deleted {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1877}} Nov 11 11:50:50.764990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:50:50.765384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f26c6f6b-4eb8-40f0-bb43-72ec9b3e2c6e not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:50:50.778831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39012) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:50.838282 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a23f248d-6977-4662-9adb-5bedb0fbd0af admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=307ee8e0c17a4e1ebce8db1a0c8ca6be&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0576761 Nov 11 11:50:50.840942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39016) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:50.902577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e975f37-90f4-416a-a4d1-5ffa5600483a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:50.931471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e975f37-90f4-416a-a4d1-5ffa5600483a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:51.106422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e975f37-90f4-416a-a4d1-5ffa5600483a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:51.111801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f7466421-8e5f-4126-b4e3-ec1bfec40bbb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:51.128335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e975f37-90f4-416a-a4d1-5ffa5600483a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4db15c24-2409-4404-b91c-2c6017946896,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:51.130965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8e975f37-90f4-416a-a4d1-5ffa5600483a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:51.134905 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e975f37-90f4-416a-a4d1-5ffa5600483a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:51.136367 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8e975f37-90f4-416a-a4d1-5ffa5600483a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4db15c24-2409-4404-b91c-2c6017946896 HTTP/1.1" status: 204 len: 168 time: 0.2943747 Nov 11 11:50:58.790882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39118) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:58.942872 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:58.984612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:50:58.984612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Usage tracker for resource:security_group_rule and tenant:0edc18a1ac004d34a74cdc8af4e9e0b8 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:50:58.986501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:50:58.992737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:50:59.153379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:59.186902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:59.194612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9eee89db-f307-4860-9101-965333a376e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:59.241741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf87f73d-7dac-4051-8539-e88b2d03f09a,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:59.245914 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=0edc18a1ac004d34a74cdc8af4e9e0b8&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4538693 Nov 11 11:50:59.246890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-98d4041b-bf47-436d-b4f9-f1d7f43ad5ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:59.248840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39124) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:59.311384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d60bf5f5-5d5b-4d6b-a53f-38d10e4dbe5c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:59.337438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d60bf5f5-5d5b-4d6b-a53f-38d10e4dbe5c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:59.409110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d60bf5f5-5d5b-4d6b-a53f-38d10e4dbe5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:59.414080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6c14b258-91e3-4b74-a664-adab19560f91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:50:59.428329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60bf5f5-5d5b-4d6b-a53f-38d10e4dbe5c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf87f73d-7dac-4051-8539-e88b2d03f09a,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:50:59.429391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d60bf5f5-5d5b-4d6b-a53f-38d10e4dbe5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:50:59.433060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d60bf5f5-5d5b-4d6b-a53f-38d10e4dbe5c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:50:59.436869 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d60bf5f5-5d5b-4d6b-a53f-38d10e4dbe5c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/cf87f73d-7dac-4051-8539-e88b2d03f09a HTTP/1.1" status: 204 len: 168 time: 0.1869826 Nov 11 11:50:59.919853 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39132) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:50:59.949155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:00.047847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:00.051998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Usage tracker for resource:security_group_rule and tenant:6250b788c87747268a7f3aa13104390a is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:00.055085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:00.061694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:00.136263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:00.175173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:00.182530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8359a032-5f46-4255-b9ca-0a64f0e24a3f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:00.225833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7823492-ed79-43c8-9d13-49658260be77,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:00.229178 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:00.233418 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6250b788c87747268a7f3aa13104390a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3113532 Nov 11 11:51:00.236224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39136) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:00.299702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-552979c4-81cb-418a-85e8-cdf9cabd9dfb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:00.326290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-552979c4-81cb-418a-85e8-cdf9cabd9dfb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:00.397716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-552979c4-81cb-418a-85e8-cdf9cabd9dfb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:00.402764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-186e08e9-343d-4617-9b92-390f1dd48416 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:00.415264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-552979c4-81cb-418a-85e8-cdf9cabd9dfb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7823492-ed79-43c8-9d13-49658260be77,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:00.417829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-552979c4-81cb-418a-85e8-cdf9cabd9dfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:00.421652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-552979c4-81cb-418a-85e8-cdf9cabd9dfb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:00.423890 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-552979c4-81cb-418a-85e8-cdf9cabd9dfb admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f7823492-ed79-43c8-9d13-49658260be77 HTTP/1.1" status: 204 len: 168 time: 0.1862266 Nov 11 11:51:04.626338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:06.539921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39216) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:06.692242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:06.725679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:06.729741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Usage tracker for resource:security_group_rule and tenant:2df2366d2f8349c08f37d8805acd4c27 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:06.733393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:06.739506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:06.807256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:06.837876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:06.845114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b84903b9-eb37-466f-b6f5-f363a094b245 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:06.886819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac36b9cd-a739-44c3-8cee-2dc9a94c2358,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:06.891013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:06.893739 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2df2366d2f8349c08f37d8805acd4c27&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3528156 Nov 11 11:51:06.896912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39222) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:06.960698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3bee66a5-838c-47b4-82d2-f06809279ac8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:06.993012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3bee66a5-838c-47b4-82d2-f06809279ac8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:07.100524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3bee66a5-838c-47b4-82d2-f06809279ac8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:07.105982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a39cc35d-dc85-4ff3-bec5-62f1dd560398 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:07.118291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bee66a5-838c-47b4-82d2-f06809279ac8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac36b9cd-a739-44c3-8cee-2dc9a94c2358,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:07.124977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3bee66a5-838c-47b4-82d2-f06809279ac8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:07.127498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3bee66a5-838c-47b4-82d2-f06809279ac8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:07.128779 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3bee66a5-838c-47b4-82d2-f06809279ac8 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ac36b9cd-a739-44c3-8cee-2dc9a94c2358 HTTP/1.1" status: 204 len: 168 time: 0.2310820 Nov 11 11:51:07.634909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39230) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:07.656183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:07.690841 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:07.695073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Usage tracker for resource:security_group_rule and tenant:27153054827f4d0fa840e092880f886f is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:07.698198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:07.705019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:07.792083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:07.826766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:07.834720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d832b19f-762c-4d05-9dfd-763f0ac4820b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:07.877359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8cb8f43-a2e0-4d61-b89e-cec8454da238,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:07.880874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:07.883635 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=27153054827f4d0fa840e092880f886f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2475123 Nov 11 11:51:07.886356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39234) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:08.154103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6e0ea2-8419-46d7-9e16-29f0d55f298e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:08.181570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6e0ea2-8419-46d7-9e16-29f0d55f298e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:08.260400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6e0ea2-8419-46d7-9e16-29f0d55f298e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:08.266078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-23395aea-2339-41cc-981c-2c9dcc041cfa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:08.278390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6e0ea2-8419-46d7-9e16-29f0d55f298e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8cb8f43-a2e0-4d61-b89e-cec8454da238,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:08.281532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8e6e0ea2-8419-46d7-9e16-29f0d55f298e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:08.283631 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6e0ea2-8419-46d7-9e16-29f0d55f298e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:08.285116 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8e6e0ea2-8419-46d7-9e16-29f0d55f298e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f8cb8f43-a2e0-4d61-b89e-cec8454da238 HTTP/1.1" status: 204 len: 168 time: 0.3974714 Nov 11 11:51:09.585510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:51:09.883213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39266) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:10.003745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-19b72ef4-ef0c-46f5-953e-2fa8236e754d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:10.044737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:10.085426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:10.089427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Usage tracker for resource:security_group_rule and tenant:8b5cebd0d787442da4fa66520f88eedb is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:10.092396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:10.098605 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:10.164448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:10.186995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:10.195208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-622a7ac5-f2aa-4791-89f6-f5b5f261be35 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:10.237287 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4928811-0dba-47f9-accd-6b46e0370fc4,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:10.240396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:10.242756 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=8b5cebd0d787442da4fa66520f88eedb&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3584402 Nov 11 11:51:10.245625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39272) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:10.311325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dce174b4-519f-4660-910e-4dfec9458d15 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:10.338278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dce174b4-519f-4660-910e-4dfec9458d15 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:10.421159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dce174b4-519f-4660-910e-4dfec9458d15 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:10.426396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-15fe2005-dc04-449d-b49d-875ae74059a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:10.439121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce174b4-519f-4660-910e-4dfec9458d15 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4928811-0dba-47f9-accd-6b46e0370fc4,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:10.442910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dce174b4-519f-4660-910e-4dfec9458d15 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:10.446218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dce174b4-519f-4660-910e-4dfec9458d15 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:10.447475 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dce174b4-519f-4660-910e-4dfec9458d15 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/a4928811-0dba-47f9-accd-6b46e0370fc4 HTTP/1.1" status: 204 len: 168 time: 0.2008402 Nov 11 11:51:11.272191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:13.474383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1e2d3056-9414-4d66-9761-e783f7b637a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:13.529873 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:14.700663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:22.903918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39400) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:23.054664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:23.088063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:23.092554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Usage tracker for resource:security_group_rule and tenant:5393831aa7844f0990162a82583b1cf4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:23.095457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:23.101572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:23.166985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:23.199444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:23.211410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-63e5fa39-498c-402e-a720-1c6c8d1695ed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:23.258961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e175675c-72fe-4145-8c9b-05a6524a3159,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:23.262361 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:23.265440 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1bbf487c-3cc3-4521-8770-11c25dd757ac admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5393831aa7844f0990162a82583b1cf4&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3597882 Nov 11 11:51:23.268284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39406) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:23.330814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-42bf5c6e-3893-4ed4-a49b-1b19392833d3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:23.357713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-42bf5c6e-3893-4ed4-a49b-1b19392833d3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:23.431999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-42bf5c6e-3893-4ed4-a49b-1b19392833d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:23.437810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8a5bd3f9-6b8b-48a6-ae0f-a8c038f543c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:23.452181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42bf5c6e-3893-4ed4-a49b-1b19392833d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e175675c-72fe-4145-8c9b-05a6524a3159,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:23.455426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-42bf5c6e-3893-4ed4-a49b-1b19392833d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:23.457508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-42bf5c6e-3893-4ed4-a49b-1b19392833d3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:23.458598 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-42bf5c6e-3893-4ed4-a49b-1b19392833d3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e175675c-72fe-4145-8c9b-05a6524a3159 HTTP/1.1" status: 204 len: 168 time: 0.1893284 Nov 11 11:51:23.972126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39416) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:23.992580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:24.024521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:24.028497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Usage tracker for resource:security_group_rule and tenant:d690535211e845d1898ee991bd4ab86c is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:24.031898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:24.037834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:24.108901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:24.140166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:24.147690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-96b828ee-cd58-4252-a432-70511e42b887 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:24.191123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4db58176-45d3-4936-891d-d13770d0bc7d,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:24.195556 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d690535211e845d1898ee991bd4ab86c&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2222891 Nov 11 11:51:24.196564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:24.198399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39420) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:24.261642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1f77910-770e-4c73-bdd0-abc2c77e8e4e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:24.289345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1f77910-770e-4c73-bdd0-abc2c77e8e4e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:24.362931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1f77910-770e-4c73-bdd0-abc2c77e8e4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:24.368112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-92f8e2df-774b-4c49-bd7c-5baed9cf0fff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:24.378980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f77910-770e-4c73-bdd0-abc2c77e8e4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4db58176-45d3-4936-891d-d13770d0bc7d,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:24.383764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b1f77910-770e-4c73-bdd0-abc2c77e8e4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:24.385704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b1f77910-770e-4c73-bdd0-abc2c77e8e4e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:24.386930 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b1f77910-770e-4c73-bdd0-abc2c77e8e4e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4db58176-45d3-4936-891d-d13770d0bc7d HTTP/1.1" status: 204 len: 168 time: 0.1874852 Nov 11 11:51:24.967663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39430) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:24.991578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:25.026884 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:25.031176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Usage tracker for resource:security_group_rule and tenant:04b96334cc554a579f0a04b75da9b2df is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:25.034274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:25.040480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:25.110541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:25.140396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:25.147892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-926dbb12-2f92-4bec-8e94-dc1719724c67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:25.190864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=498f9804-ba0b-407f-b3ed-338ebf410367,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:25.194008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:25.196417 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=04b96334cc554a579f0a04b75da9b2df&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2275436 Nov 11 11:51:25.204609 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39434) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:25.263635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-90e08eb6-0ea6-417a-bee0-784a0462e825 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:25.290356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-90e08eb6-0ea6-417a-bee0-784a0462e825 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:25.369095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-90e08eb6-0ea6-417a-bee0-784a0462e825 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:25.374861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-083a2a98-a954-4610-ada4-053aa425e89b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:25.388414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90e08eb6-0ea6-417a-bee0-784a0462e825 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=498f9804-ba0b-407f-b3ed-338ebf410367,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:25.391211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-90e08eb6-0ea6-417a-bee0-784a0462e825 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:25.392398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-90e08eb6-0ea6-417a-bee0-784a0462e825 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:25.393607 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-90e08eb6-0ea6-417a-bee0-784a0462e825 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/498f9804-ba0b-407f-b3ed-338ebf410367 HTTP/1.1" status: 204 len: 168 time: 0.1933517 Nov 11 11:51:34.625952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:37.168473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39558) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:37.341620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:37.376046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:37.380075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Usage tracker for resource:security_group_rule and tenant:ea7e2b42533a4ecaa7576909955abbad is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:37.382993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:37.389015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:37.456627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:37.489023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:37.497219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ff60e541-3e07-4eb5-8dc9-0e3159f0d0a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:37.541313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd2c8330-a170-427d-b1a7-a4d8c205de09,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:37.544851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:37.553989 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-df9de8f3-96df-4291-9c5b-715f18b0ffb0 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ea7e2b42533a4ecaa7576909955abbad&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3798678 Nov 11 11:51:37.553989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39564) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:37.622874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-313981af-5c32-4775-9141-1db3e0e845f6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:37.650832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-313981af-5c32-4775-9141-1db3e0e845f6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:37.729425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-313981af-5c32-4775-9141-1db3e0e845f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:37.734085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9cb4aec9-3700-42e5-9b55-98f88e418191 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:37.745954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-313981af-5c32-4775-9141-1db3e0e845f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd2c8330-a170-427d-b1a7-a4d8c205de09,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:37.748420 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-313981af-5c32-4775-9141-1db3e0e845f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:37.755470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-313981af-5c32-4775-9141-1db3e0e845f6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:37.756360 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-313981af-5c32-4775-9141-1db3e0e845f6 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/cd2c8330-a170-427d-b1a7-a4d8c205de09 HTTP/1.1" status: 204 len: 168 time: 0.2017591 Nov 11 11:51:38.262035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39572) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:38.282013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:38.314449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:38.318427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Usage tracker for resource:security_group_rule and tenant:643b8fe720254b8a8595f6f27d2bcd39 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:38.321474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:38.328128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:38.399273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:38.425766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:38.433059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5d70b7ce-db9b-436a-95be-a08663cb68c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:38.475134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f939eca-e7c5-41e8-be32-ee689ac228bc,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:38.480238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:38.484386 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=643b8fe720254b8a8595f6f27d2bcd39&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2205732 Nov 11 11:51:38.486555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39576) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:38.553292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6d9776-e441-478b-ad99-ff21c19d46a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:38.585999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6d9776-e441-478b-ad99-ff21c19d46a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:38.672152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6d9776-e441-478b-ad99-ff21c19d46a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:38.677755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a9cf522c-41a3-48e7-8049-a665e8b79ed1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:38.691643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6d9776-e441-478b-ad99-ff21c19d46a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f939eca-e7c5-41e8-be32-ee689ac228bc,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:38.694904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8e6d9776-e441-478b-ad99-ff21c19d46a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:38.697017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6d9776-e441-478b-ad99-ff21c19d46a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:38.698262 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8e6d9776-e441-478b-ad99-ff21c19d46a0 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/5f939eca-e7c5-41e8-be32-ee689ac228bc HTTP/1.1" status: 204 len: 168 time: 0.2108531 Nov 11 11:51:39.273076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39584) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:39.294423 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:39.328050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:39.332013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Usage tracker for resource:security_group_rule and tenant:d464eec8076c43429f7c574e3cf81feb is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:39.334952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:39.341089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:39.410732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:39.448656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:39.456958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a25c30dd-c4fc-4f02-9393-907ec5cc9fc4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:39.500037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2bfae448-9d3b-42f6-8782-31d5f39a2270,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:39.503600 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:39.506343 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d464eec8076c43429f7c574e3cf81feb&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2321382 Nov 11 11:51:39.509859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39588) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:39.579007 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:39.614100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:39.712900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:39.718034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-458a0185-ef19-4c47-a700-19626325182c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:39.729455 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2bfae448-9d3b-42f6-8782-31d5f39a2270,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:39.741511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:39.742752 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2bfae448-9d3b-42f6-8782-31d5f39a2270 HTTP/1.1" status: 204 len: 168 time: 0.2318220 Nov 11 11:51:39.744903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.745536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.745717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.746127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.746537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.747080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.747521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.747928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.748337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.749235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.749608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:39.752888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:40.037772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d896d04d-7354-45a3-86ce-7aac6e62e564 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:41.277945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:42.413038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e24a187-c219-42a4-aa42-368d461f64e8 req-3d087b39-3b30-4ce6-8ee2-8d4392355d2b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:42.414632 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e24a187-c219-42a4-aa42-368d461f64e8 req-3d087b39-3b30-4ce6-8ee2-8d4392355d2b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 946 time: 0.0865324 Nov 11 11:51:42.463041 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e24a187-c219-42a4-aa42-368d461f64e8 req-19ceb462-e5b9-4c6a-be2b-f7f86426efda tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415001 Nov 11 11:51:43.140524 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b5b65afc-b69a-4b65-b2ac-78f7ec480866 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/networks?tenant_id=9c8b52a8fc514d4a8645074916ba1628&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0326512 Nov 11 11:51:43.304731 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b90d42b8-fd91-49b5-ba38-743ddc4c44e0 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:43.306348 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b90d42b8-fd91-49b5-ba38-743ddc4c44e0 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1602859 Nov 11 11:51:43.324019 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-93327c6c-e3d7-463a-8d62-6365aa5b0158 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/quotas/9c8b52a8fc514d4a8645074916ba1628 HTTP/1.1" status: 200 len: 375 time: 0.0117414 Nov 11 11:51:43.376305 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-fa0b4351-9616-43d0-8a44-515baeac7fbb tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9c8b52a8fc514d4a8645074916ba1628&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0458524 Nov 11 11:51:43.480919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ddd3d83a-7823-41e0-98c4-63d8074d743a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:43.563820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:43.674670 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-352c0cb1-d177-4d10-b8f1-a3b6683fd4a8 req-e060574b-d54c-451c-87eb-73835f2c779d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 210 time: 0.0885105 Nov 11 11:51:43.732200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b62cc21-33d1-4dc6-a34b-b901abcf2641 req-9edc77b5-7b80-40ee-b2d0-04677dbdf5f5 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:43.733975 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7b62cc21-33d1-4dc6-a34b-b901abcf2641 req-9edc77b5-7b80-40ee-b2d0-04677dbdf5f5 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 946 time: 0.1083257 Nov 11 11:51:43.783722 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7b62cc21-33d1-4dc6-a34b-b901abcf2641 req-cb7a2471-4386-440d-bb59-8d70cb7410e4 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436816 Nov 11 11:51:44.111099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-39b24ff4-0454-4e6d-bdc5-410f986cbae1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:44.112693 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-39b24ff4-0454-4e6d-bdc5-410f986cbae1 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 946 time: 0.0924861 Nov 11 11:51:44.187993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Deleting port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:51:44.188392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:44.466630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] For port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:51:44.467046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:44.751698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:44.800620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:44.801042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:44.801408 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Floating IP 6949a680-ec2a-4ea5-84e9-e1ec3fde95fc disassociated. External IP: 172.27.3.45, port: 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30. Nov 11 11:51:44.801796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Calling delete_port for 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:51:44.893289 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-78dd28c0-201c-4cae-97fc-23278175d422 req-1f340080-ba2a-42fb-95d4-7c2e7e23a374 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 210 time: 0.0622585 Nov 11 11:51:45.085476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e480073d-fc4e-44a1-a30b-fe7a07fe3b22 req-63795484-52f5-46e6-b94e-e6d3bdf24e1c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:45.087032 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e480073d-fc4e-44a1-a30b-fe7a07fe3b22 req-63795484-52f5-46e6-b94e-e6d3bdf24e1c tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 946 time: 0.1568604 Nov 11 11:51:45.111038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:45.119702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aa6aab7f-5d59-43c8-99ed-527f67965e74 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:45.172713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event deleted for resources: {'Port': ['ID=99e8580d-0f13-4a11-8a52-ea3fd2c9ac30,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:45.178000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:45.196986 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e480073d-fc4e-44a1-a30b-fe7a07fe3b22 req-83254724-9ec4-4d31-b531-ef32b9077a67 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups?id=bea744fc-9c93-4c10-ad8b-f33108eb55e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1036439 Nov 11 11:51:45.513221 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-5bf04d33-fe3a-42f9-8be7-3dcc8ff05145 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.60 "GET /v2.0/networks?tenant_id=9c8b52a8fc514d4a8645074916ba1628&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0455244 Nov 11 11:51:45.783033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-775dcf87-da55-459b-9ee2-b21f8a9de48e tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:45.784603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-775dcf87-da55-459b-9ee2-b21f8a9de48e tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2658997 Nov 11 11:51:45.802231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Request body: {'port': {'device_id': '667d9c4c-eae8-4553-9f69-edc322b4f934', 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930', 'admin_state_up': True, 'tenant_id': '9c8b52a8fc514d4a8645074916ba1628'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:51:45.963833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Router b0d78112-9416-496e-b447-57849419e81d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:51:45.996173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:46.003711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Usage tracker for resource:port and tenant:9c8b52a8fc514d4a8645074916ba1628 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:46.007227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:46.075652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:46.137507 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1af1d492-505f-4ee6-8308-59cba7691994 req-56d0e9b2-67bb-43c9-99df-664de580eb5a tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 210 time: 0.0717967 Nov 11 11:51:46.222837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Made reservation on behalf of 9c8b52a8fc514d4a8645074916ba1628 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:51:46.228379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:46.250051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:46.309893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:51:46.317750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Usage tracker for resource:security_group_rule and tenant:9c8b52a8fc514d4a8645074916ba1628 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:51:46.321526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:51:46.331381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:51:46.408628 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e4d07b0-e15d-40a8-93c5-293e66e63a3b req-ed866f0d-be88-45aa-95d9-2b0015730d98 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/ports?device_id=b2f17b5a-635f-4b02-a5be-3c62211c8e87 HTTP/1.1" status: 200 len: 210 time: 0.0652499 Nov 11 11:51:46.412734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:51:46.423997 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] Sync routers for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:51:46.438879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:51:46.439501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:51:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:51:46.503449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] No DVR routers for this DVR port 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:51:46.510668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:46.516767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-deleted', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:51:46.571332 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:46.587185 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b2f17b5a-635f-4b02-a5be-3c62211c8e87', 'name': 'network-vif-deleted', 'tag': '99e8580d-0f13-4a11-8a52-ea3fd2c9ac30', 'status': 'completed', 'code': 200} Nov 11 11:51:46.588690 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-66eee827-8d53-43df-8f9f-7a0a2deabb93 req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.60 "DELETE /v2.0/ports/99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 HTTP/1.1" status: 204 len: 173 time: 2.4696569 Nov 11 11:51:46.608990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:46.616512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2b2adbdf-382e-421d-ab26-4a34a2d1a2ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:46.619976 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:51:46.667496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:51:46.703867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b624ee76-b4ef-47aa-834a-1dec64b70404,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:46.726898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:46.863675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Allocated IP 192.168.233.246 (aca53216-c72b-4292-ba2a-d0bc29443930/e1145c7e-4bad-4396-9274-f75f0d69f336/4def8f29-7e3f-49b7-b1f2-af1af852e924) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:51:47.118972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:47.137195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Transition to ACTIVE for port object 4def8f29-7e3f-49b7-b1f2-af1af852e924 will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:51:47.187501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:47.188441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:51:47.193973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] Checking router: b0d78112-9416-496e-b447-57849419e81d for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:51:47.194543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-470df7e6-7090-4f42-beec-1ce162da704a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:47.207047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:51:47.207792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:51:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:51:47.262006 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Network aca53216-c72b-4292-ba2a-d0bc29443930 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:51:47.270485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:51:47.275670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:51:47.315555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Pushing event updated for resources: {'Port': ['ID=4def8f29-7e3f-49b7-b1f2-af1af852e924,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:47.325093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:47.410351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:47.411247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:47.416142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:51:47.466521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85c40a9-6f15-4c87-b887-1f0f4a99150b req-9d5e8a40-c2cc-4778-99ef-349ac158aefe tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:47.467962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-a85c40a9-6f15-4c87-b887-1f0f4a99150b req-9d5e8a40-c2cc-4778-99ef-349ac158aefe tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Synchronizing usage tracker for tenant:9c8b52a8fc514d4a8645074916ba1628 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:51:47.480630 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.6833215 Nov 11 11:51:47.535370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-a85c40a9-6f15-4c87-b887-1f0f4a99150b req-9d5e8a40-c2cc-4778-99ef-349ac158aefe tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Unset dirty status for tenant:9c8b52a8fc514d4a8645074916ba1628 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:51:47.537454 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a85c40a9-6f15-4c87-b887-1f0f4a99150b req-9d5e8a40-c2cc-4778-99ef-349ac158aefe tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 936 time: 0.1964724 Nov 11 11:51:47.626166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-a85c40a9-6f15-4c87-b887-1f0f4a99150b req-61fe7fb3-5d65-4a4e-834b-34de4d464ade tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Synchronizing usage tracker for tenant:9c8b52a8fc514d4a8645074916ba1628 on resource:security_group {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:51:47.705693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-a85c40a9-6f15-4c87-b887-1f0f4a99150b req-61fe7fb3-5d65-4a4e-834b-34de4d464ade tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Unset dirty status for tenant:9c8b52a8fc514d4a8645074916ba1628 on resource:security_group {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:51:47.707086 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a85c40a9-6f15-4c87-b887-1f0f4a99150b req-61fe7fb3-5d65-4a4e-834b-34de4d464ade tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1630795 Nov 11 11:51:47.734944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Request body: {'port': {'device_id': '667d9c4c-eae8-4553-9f69-edc322b4f934', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:51:47.753413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39680) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:47.781199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c5fcdda8-ecab-4b99-98dd-b6536d475237 None None] Provisioning for port 4def8f29-7e3f-49b7-b1f2-af1af852e924 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:51:47.790172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c5fcdda8-ecab-4b99-98dd-b6536d475237 None None] Provisioning complete for port 4def8f29-7e3f-49b7-b1f2-af1af852e924 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:51:47.791089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5fcdda8-ecab-4b99-98dd-b6536d475237 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:47.828858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:51:47.833850 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4938db3-6127-4c32-9696-e261d5820bd8 None None] The sync data for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi is: [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:40:26Z', 'revision_number': 4, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'b5579f75-6ab0-4891-a00f-12003d90eb5a', 'name': '', 'network_id': '95fd47ac-3c3a-4852-88d6-8eed6cc12159', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'mac_address': 'fa:16:3e:d9:e5:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:24Z', 'updated_at': '2021-11-11T11:40:45Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'subnets': [{'id': '438f756e-e154-4e6d-b79f-74ad54d1cabe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:51:47.859352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c5fcdda8-ecab-4b99-98dd-b6536d475237 None None] Port 4def8f29-7e3f-49b7-b1f2-af1af852e924 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:51:47.860015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:47.881510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4e1f786c-2ded-4661-b9ec-e2363286e441 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:47.914096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4e1f786c-2ded-4661-b9ec-e2363286e441 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.179493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4e1f786c-2ded-4661-b9ec-e2363286e441 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.180351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:51:48.185354 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-660789e4-cef9-47e6-8371-031188a4ced6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:48.201040 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e1f786c-2ded-4661-b9ec-e2363286e441 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bea744fc-9c93-4c10-ad8b-f33108eb55e8,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:48.205352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4e1f786c-2ded-4661-b9ec-e2363286e441 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:48.230128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:51:48.231523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 99e8580d-0f13-4a11-8a52-ea3fd2c9ac30 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:51:48.254400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4e1f786c-2ded-4661-b9ec-e2363286e441 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.256061 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4e1f786c-2ded-4661-b9ec-e2363286e441 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "DELETE /v2.0/security-groups/bea744fc-9c93-4c10-ad8b-f33108eb55e8 HTTP/1.1" status: 204 len: 168 time: 0.5011473 Nov 11 11:51:48.258666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39684) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:48.272593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4def8f29-7e3f-49b7-b1f2-af1af852e924 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:51:48.280300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.281798 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.api.v2.resource [None req-1ac85b85-d6e9-4b74-ba34-a51b550a980e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] show failed (client error): The resource could not be found. Nov 11 11:51:48.282929 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1ac85b85-d6e9-4b74-ba34-a51b550a980e tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "GET /v2.0/security-groups/bea744fc-9c93-4c10-ad8b-f33108eb55e8 HTTP/1.1" status: 404 len: 347 time: 0.0229158 Nov 11 11:51:48.285990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39688) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:48.296803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Transition to ACTIVE for port object 4def8f29-7e3f-49b7-b1f2-af1af852e924 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:51:48.334364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.339264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1834d807-5bd8-432e-96ff-5593e40432cc tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:48.362772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6328e9a-96df-4aeb-a4ac-287b5533d3a9 None None] New status for floating IP 6949a680-ec2a-4ea5-84e9-e1ec3fde95fc: DOWN {{(pid=88330) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:51:48.453169 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Deleting port 08fde528-8742-4ae4-9aa6-8ae54a3ea6f9 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:51:48.453557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.473188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Pushing event updated for resources: {'Port': ['ID=4def8f29-7e3f-49b7-b1f2-af1af852e924,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:48.477188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:48.604403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Attempting to bind port 4def8f29-7e3f-49b7-b1f2-af1af852e924 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:51:48.605061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Attempting to bind port 4def8f29-7e3f-49b7-b1f2-af1af852e924 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:51:48.605563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Attempting to bind port 4def8f29-7e3f-49b7-b1f2-af1af852e924 on network aca53216-c72b-4292-ba2a-d0bc29443930 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:51:48.616550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Port 4def8f29-7e3f-49b7-b1f2-af1af852e924 on network aca53216-c72b-4292-ba2a-d0bc29443930 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:51:48.617077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Attempting to bind port 4def8f29-7e3f-49b7-b1f2-af1af852e924 on network aca53216-c72b-4292-ba2a-d0bc29443930 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:51:48.626442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 51, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:51:48.627008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Checking segment: {'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:51:48.627582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Bound using segment: {'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:51:48.628205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Bound port: 4def8f29-7e3f-49b7-b1f2-af1af852e924, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c7e3cfb8-478a-49a8-8a62-e44b81ddec99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:51:48.629150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.665320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.665980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.730217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] For port 4def8f29-7e3f-49b7-b1f2-af1af852e924, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:51:48.734833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] For port 4def8f29-7e3f-49b7-b1f2-af1af852e924, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4def8f29-7e3f-49b7-b1f2-af1af852e924,segment=NetworkSegment(c7e3cfb8-478a-49a8-8a62-e44b81ddec99),segment_id=c7e3cfb8-478a-49a8-8a62-e44b81ddec99)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:51:48.769186 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.774456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-71b771e1-5d5c-4c1c-ab52-45b55b799645 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:48.818963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Calling delete_port for 08fde528-8742-4ae4-9aa6-8ae54a3ea6f9 owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:51:48.845092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:48.846893 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] 10.222.0.60 "PUT /v2.0/ports/4def8f29-7e3f-49b7-b1f2-af1af852e924 HTTP/1.1" status: 200 len: 1098 time: 1.3581674 Nov 11 11:51:48.847585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '667d9c4c-eae8-4553-9f69-edc322b4f934', 'tag': '4def8f29-7e3f-49b7-b1f2-af1af852e924'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:51:48.871452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Pushing event updated for resources: {'Port': ['ID=4def8f29-7e3f-49b7-b1f2-af1af852e924,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:48.911044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:48.960674 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '667d9c4c-eae8-4553-9f69-edc322b4f934', 'tag': '4def8f29-7e3f-49b7-b1f2-af1af852e924', 'status': 'completed', 'code': 200} Nov 11 11:51:49.022881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d0739b-4a2e-49e7-9f62-eecf24f8b714 req-3bc1ebb6-9087-47c7-9aea-9cdd15f8ea3b tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:49.024595 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7d0739b-4a2e-49e7-9f62-eecf24f8b714 req-3bc1ebb6-9087-47c7-9aea-9cdd15f8ea3b tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 948 time: 0.1582499 Nov 11 11:51:49.051686 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-ecb23a6d-12ab-4484-aa60-d8201dcf5ef0 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c8b52a8fc514d4a8645074916ba1628&device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 1101 time: 0.1345220 Nov 11 11:51:49.100691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 2 row(s); 1 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88328) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:51:49.101102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:51:49.142763 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-594cb1f0-2082-4fb9-be32-ff513e132b78 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.246&port_id=4def8f29-7e3f-49b7-b1f2-af1af852e924 HTTP/1.1" status: 200 len: 217 time: 0.0821691 Nov 11 11:51:49.148547 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a7d0739b-4a2e-49e7-9f62-eecf24f8b714 req-f9e60cd1-af28-42c7-af77-2fa5dc1e8b39 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163154 Nov 11 11:51:49.428260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-94c3cffb-dbd6-4437-b06f-732f0ec85c2d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:49.430030 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-94c3cffb-dbd6-4437-b06f-732f0ec85c2d service neutron] 10.222.0.60 "GET /v2.0/subnets?id=e1145c7e-4bad-4396-9274-f75f0d69f336 HTTP/1.1" status: 200 len: 843 time: 0.2804606 Nov 11 11:51:49.512157 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-9d87d51e-4df5-45bc-91f8-415732b98fd6 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=aca53216-c72b-4292-ba2a-d0bc29443930&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0755327 Nov 11 11:51:49.602054 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Deleting port 08fde528-8742-4ae4-9aa6-8ae54a3ea6f9 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:51:49.602453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:49.666965 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-31c0e4c3-6fb8-46f9-a01c-730943f2ffac service neutron] 10.222.0.60 "GET /v2.0/networks/aca53216-c72b-4292-ba2a-d0bc29443930?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1460035 Nov 11 11:51:49.790410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:49.790779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:49.820389 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3f583bff-91a4-432d-9dce-06b91ffac074 req-29464eb1-7658-42f4-9900-016a41934f93 service neutron] 10.222.0.60 "GET /v2.0/networks/aca53216-c72b-4292-ba2a-d0bc29443930?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1465478 Nov 11 11:51:49.937088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Calling delete_port for 08fde528-8742-4ae4-9aa6-8ae54a3ea6f9 owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:51:49.986858 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-149f74c3-70c8-4d61-bb94-70def50bcd2f service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c8b52a8fc514d4a8645074916ba1628&device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 1101 time: 0.0866611 Nov 11 11:51:50.136646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:50.143379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:50.145364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-31ff8b33-8118-451d-92bc-b1bdf1ad135b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:50.146967 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-31ff8b33-8118-451d-92bc-b1bdf1ad135b service neutron] 10.222.0.60 "GET /v2.0/networks?id=aca53216-c72b-4292-ba2a-d0bc29443930 HTTP/1.1" status: 200 len: 871 time: 0.1528625 Nov 11 11:51:50.197800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Pushing event deleted for resources: {'Port': ['ID=08fde528-8742-4ae4-9aa6-8ae54a3ea6f9,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:50.202553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:50.224409 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-be96b900-21fc-404b-9d91-e53be7ed42cc service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.246&port_id=4def8f29-7e3f-49b7-b1f2-af1af852e924 HTTP/1.1" status: 200 len: 217 time: 0.0702870 Nov 11 11:51:50.296773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks [] for floatingip, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:50.315725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:50.317181 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] 10.222.0.11 "DELETE /v2.0/floatingips/6949a680-ec2a-4ea5-84e9-e1ec3fde95fc HTTP/1.1" status: 204 len: 168 time: 2.0301552 Nov 11 11:51:50.339909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-30287216-8917-40ff-a23a-1191940f3fbb service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:50.341511 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-30287216-8917-40ff-a23a-1191940f3fbb service neutron] 10.222.0.60 "GET /v2.0/subnets?id=e1145c7e-4bad-4396-9274-f75f0d69f336 HTTP/1.1" status: 200 len: 843 time: 0.1110721 Nov 11 11:51:50.439817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54bb9e0-6c8b-4eae-9bf4-0ff70145af58 req-caa90c74-027f-4337-99d1-e7c404357507 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:50.441529 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c54bb9e0-6c8b-4eae-9bf4-0ff70145af58 req-caa90c74-027f-4337-99d1-e7c404357507 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 948 time: 0.1538420 Nov 11 11:51:50.485226 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-e8433a92-a6a0-4c9d-a9f9-cc2309962aae service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=aca53216-c72b-4292-ba2a-d0bc29443930&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1363013 Nov 11 11:51:50.604507 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c54bb9e0-6c8b-4eae-9bf4-0ff70145af58 req-f964c3f9-1ff2-421d-a175-887b03843f75 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1509264 Nov 11 11:51:50.658967 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-1201e0e5-4a63-45a5-9627-3fafd1c62e0a service neutron] 10.222.0.60 "GET /v2.0/networks/aca53216-c72b-4292-ba2a-d0bc29443930?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1639192 Nov 11 11:51:50.807620 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089dd74d-274d-4321-8cd0-231c81fefa11 req-589e0567-f766-409e-a52f-7055af4df8cd service neutron] 10.222.0.60 "GET /v2.0/networks/aca53216-c72b-4292-ba2a-d0bc29443930?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1420906 Nov 11 11:51:51.871783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f780a984-6de0-409d-839f-a02fa8dd0f76 req-7b10bd54-ec7b-4b2d-9cf1-e5d97be8bd0f tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:51.871783 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f780a984-6de0-409d-839f-a02fa8dd0f76 req-7b10bd54-ec7b-4b2d-9cf1-e5d97be8bd0f tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 948 time: 0.1351771 Nov 11 11:51:51.924828 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f780a984-6de0-409d-839f-a02fa8dd0f76 req-2b2be0d7-ed46-4542-9f2f-dff7f97ee07d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488303 Nov 11 11:51:53.132954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6113a8bf-ef9a-4975-9fba-fb9c42136dd7 req-4652da2c-6fb2-4d74-ac44-3d126e2cfdd2 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:53.134545 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6113a8bf-ef9a-4975-9fba-fb9c42136dd7 req-4652da2c-6fb2-4d74-ac44-3d126e2cfdd2 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 948 time: 0.0824106 Nov 11 11:51:53.187481 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6113a8bf-ef9a-4975-9fba-fb9c42136dd7 req-98a75f0b-c715-4019-9749-962f9c87c103 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467503 Nov 11 11:51:53.429883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39726) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:54.113810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:54.208336 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 4def8f29-7e3f-49b7-b1f2-af1af852e924 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:51:54.356826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 4def8f29-7e3f-49b7-b1f2-af1af852e924, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4def8f29-7e3f-49b7-b1f2-af1af852e924,segment=NetworkSegment(c7e3cfb8-478a-49a8-8a62-e44b81ddec99),segment_id=c7e3cfb8-478a-49a8-8a62-e44b81ddec99)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:51:54.373070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '4def8f29-7e3f-49b7-b1f2-af1af852e924', 'network_id': 'aca53216-c72b-4292-ba2a-d0bc29443930', 'port_id': '4def8f29-7e3f-49b7-b1f2-af1af852e924', 'mac_address': 'fa:16:3e:35:60:fc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1041, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e1145c7e-4bad-4396-9274-f75f0d69f336', 'ip_address': '192.168.233.246'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:51:54.400614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf8d2cf-7d14-4db3-aa61-203a4882e3a0 req-fbc0321f-b5e9-4762-8d7d-c4e5fa0bbe44 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:54.402407 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fdf8d2cf-7d14-4db3-aa61-203a4882e3a0 req-fbc0321f-b5e9-4762-8d7d-c4e5fa0bbe44 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 948 time: 0.0854099 Nov 11 11:51:54.432959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:54.462004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4def8f29-7e3f-49b7-b1f2-af1af852e924 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:51:54.472241 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fdf8d2cf-7d14-4db3-aa61-203a4882e3a0 req-8fb7ebb9-1f3f-40ec-b2b2-5eaa47326745 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619688 Nov 11 11:51:54.479647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 4def8f29-7e3f-49b7-b1f2-af1af852e924, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4def8f29-7e3f-49b7-b1f2-af1af852e924,segment=NetworkSegment(c7e3cfb8-478a-49a8-8a62-e44b81ddec99),segment_id=c7e3cfb8-478a-49a8-8a62-e44b81ddec99)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:51:54.511468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:54.513386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3f06f218-ede7-46c8-98e1-075ae40f83c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:54.599330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=4def8f29-7e3f-49b7-b1f2-af1af852e924,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:54.609218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.609603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.609986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.610360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.610728 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.611100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.611516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.611866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.612231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.612594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.612954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:51:54.617210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:54.784474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Deleting port b5579f75-6ab0-4891-a00f-12003d90eb5a {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:51:54.784846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:54.888836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['4def8f29-7e3f-49b7-b1f2-af1af852e924'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:51:54.968042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] For port b5579f75-6ab0-4891-a00f-12003d90eb5a, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=b5579f75-6ab0-4891-a00f-12003d90eb5a,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:51:54.968521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:55.294680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Calling delete_port for b5579f75-6ab0-4891-a00f-12003d90eb5a owned by network:router_interface {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:51:55.720182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:55.725534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:55.748291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc9fda3-8e76-45ca-9612-e9f060ca07f4 req-5acbe92a-ab30-42f2-9336-ddcc0e959c9f tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:55.750042 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8fc9fda3-8e76-45ca-9612-e9f060ca07f4 req-5acbe92a-ab30-42f2-9336-ddcc0e959c9f tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 949 time: 0.0911679 Nov 11 11:51:55.769865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=b5579f75-6ab0-4891-a00f-12003d90eb5a,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:55.772842 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:55.805241 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8fc9fda3-8e76-45ca-9612-e9f060ca07f4 req-10ef1230-a71f-4b65-8f43-978534239b62 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475049 Nov 11 11:51:56.100736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:56.208431 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 4def8f29-7e3f-49b7-b1f2-af1af852e924 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:51:56.317034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 4def8f29-7e3f-49b7-b1f2-af1af852e924 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:51:56.325521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 4def8f29-7e3f-49b7-b1f2-af1af852e924 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:51:56.325521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:56.446836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:56.485785 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '667d9c4c-eae8-4553-9f69-edc322b4f934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4def8f29-7e3f-49b7-b1f2-af1af852e924'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:51:56.496424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 4def8f29-7e3f-49b7-b1f2-af1af852e924, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4def8f29-7e3f-49b7-b1f2-af1af852e924,segment=NetworkSegment(c7e3cfb8-478a-49a8-8a62-e44b81ddec99),segment_id=c7e3cfb8-478a-49a8-8a62-e44b81ddec99)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:51:56.528319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:56.531253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:56.562435 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '667d9c4c-eae8-4553-9f69-edc322b4f934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4def8f29-7e3f-49b7-b1f2-af1af852e924', 'code': 200} Nov 11 11:51:56.604079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=4def8f29-7e3f-49b7-b1f2-af1af852e924,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:56.607260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:56.763505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Router b0d78112-9416-496e-b447-57849419e81d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:51:56.859900 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-76ba7235-3724-4508-9bac-dc2ff36eec7d req-b559ac69-c0d9-41a5-aaa8-2da1c9ef4714 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 1103 time: 0.0739694 Nov 11 11:51:56.908198 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-76ba7235-3724-4508-9bac-dc2ff36eec7d req-dcf2c8f7-cbcf-4a6b-a2d2-d88688d0a78a service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420547 Nov 11 11:51:56.982608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:51:56.993814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] Sync routers for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:51:56.996298 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] 10.222.0.11 "PUT /v2.0/routers/b0d78112-9416-496e-b447-57849419e81d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5652001 Nov 11 11:51:56.999597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39740) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:57.007625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:51:57.008502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:51:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:51:57.026037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab8f4ab-4044-4d5b-bef7-48bcb6cbb19d req-64d7c93a-1c50-4e6f-b580-881693f80007 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:57.027694 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4ab8f4ab-4044-4d5b-bef7-48bcb6cbb19d req-64d7c93a-1c50-4e6f-b580-881693f80007 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 950 time: 0.0899107 Nov 11 11:51:57.079448 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4ab8f4ab-4044-4d5b-bef7-48bcb6cbb19d req-772ef695-198b-4384-b6fa-2043ea47bf60 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441675 Nov 11 11:51:57.214555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:51:57.408165 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks [] for router, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:57.517329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:51:55Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:51:57.522198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] Checking router: b0d78112-9416-496e-b447-57849419e81d for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:51:57.533540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] Routers {'b0d78112-9416-496e-b447-57849419e81d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:51:57.534177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:51:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['b0d78112-9416-496e-b447-57849419e81d'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:51:57.619391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:57.672543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Deleting port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:51:57.672853 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:57.726485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] Set router b0d78112-9416-496e-b447-57849419e81d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:51:57.862213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] For port 5eadec18-337a-4eb6-aa8f-d9d1a9f98039, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=5eadec18-337a-4eb6-aa8f-d9d1a9f98039,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:51:57.862619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:57.994510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Calling delete_port for 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 owned by network:router_gateway {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:51:58.037324 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:51:55Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:51:58.041694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-984f097a-c184-43cb-9e1a-10b2a3e85e21 None None] The sync data for ids ['b0d78112-9416-496e-b447-57849419e81d'] in dv-cinder-817417-1-iscsi is: [{'id': 'b0d78112-9416-496e-b447-57849419e81d', 'name': 'tempest-AttachVolumeShelveTestJSON-615335580-router', 'tenant_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:40:15Z', 'updated_at': '2021-11-11T11:51:55Z', 'revision_number': 5, 'project_id': '49b88e3cf8f748be91f37e0b9caccf6d', 'gw_port': {'id': '5eadec18-337a-4eb6-aa8f-d9d1a9f98039', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:70:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0d78112-9416-496e-b447-57849419e81d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:40:16Z', 'updated_at': '2021-11-11T11:40:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:51:58.260033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:58.273109 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c2dde76b-2fa6-4179-9e07-0a92310a3149 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:58.309517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c219edf-699a-4dfc-a30b-1ff83d55fd61 req-10e7d346-d662-44c0-a14d-e8f86c2f8013 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:58.311293 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8c219edf-699a-4dfc-a30b-1ff83d55fd61 req-10e7d346-d662-44c0-a14d-e8f86c2f8013 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 950 time: 0.0859828 Nov 11 11:51:58.354129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Pushing event deleted for resources: {'Port': ['ID=5eadec18-337a-4eb6-aa8f-d9d1a9f98039,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:58.361414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:58.370834 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8c219edf-699a-4dfc-a30b-1ff83d55fd61 req-7002a79f-941c-484f-8b4d-28ae5296795c tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527804 Nov 11 11:51:58.565241 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:58.751805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device b5579f75-6ab0-4891-a00f-12003d90eb5a no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:51:58.785661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: b5579f75-6ab0-4891-a00f-12003d90eb5a {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:51:58.786064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device b5579f75-6ab0-4891-a00f-12003d90eb5a not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:51:58.844215 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:58.849021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.013803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.014453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Fanout notify agent at l3_agent the message router_deleted on router b0d78112-9416-496e-b447-57849419e81d {{(pid=88328) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 11:51:59.027925 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.029213 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] 10.222.0.11 "DELETE /v2.0/routers/b0d78112-9416-496e-b447-57849419e81d HTTP/1.1" status: 204 len: 168 time: 2.0286191 Nov 11 11:51:59.031999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39746) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:59.103895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] Deleting subnet 438f756e-e154-4e6d-b79f-74ad54d1cabe {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:51:59.107518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.160895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036850920695'] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.285052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.368832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2678040', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2638849'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.374387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1dc47fd6-492b-4145-a90c-5ab1e5d3dda8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:51:59.412885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=438f756e-e154-4e6d-b79f-74ad54d1cabe,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:51:59.417441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:51:59.421134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.430225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83a22634-622c-4a3b-8950-9e4f1e47a985 None None] Network 95fd47ac-3c3a-4852-88d6-8eed6cc12159 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:51:59.430386 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e8abfc9c-f423-405d-84dc-8dff20b97938 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/438f756e-e154-4e6d-b79f-74ad54d1cabe HTTP/1.1" status: 204 len: 168 time: 0.3946240 Nov 11 11:51:59.430472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39752) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:51:59.551673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.564955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Deleting port 19777011-5a23-4943-933c-9702ae0d11ce {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:51:59.565297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.627640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48f8d799-e59b-40dc-ac89-dc710544e05f req-0e05c822-7b9a-4b02-88c8-2a130332e830 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:51:59.629393 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-48f8d799-e59b-40dc-ac89-dc710544e05f req-0e05c822-7b9a-4b02-88c8-2a130332e830 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 950 time: 0.1227133 Nov 11 11:51:59.685450 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-48f8d799-e59b-40dc-ac89-dc710544e05f req-7d05d076-cbad-4af1-83ff-752b87c40c9e tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485463 Nov 11 11:51:59.807302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] For port 19777011-5a23-4943-933c-9702ae0d11ce, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=19777011-5a23-4943-933c-9702ae0d11ce,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:51:59.807659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.899114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] DHCP port deletion for 95fd47ac-3c3a-4852-88d6-8eed6cc12159 request from dv-cinder-817417-1-iscsi {{(pid=88330) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:247}} Nov 11 11:51:59.903783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] Deleting port 19777011-5a23-4943-933c-9702ae0d11ce {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:51:59.904199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:51:59.948220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Calling delete_port for 19777011-5a23-4943-933c-9702ae0d11ce owned by network:dhcp {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:52:00.083264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:00.089425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4c1457fa-7676-4181-b040-1cbca281ce31 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:00.133437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Pushing event deleted for resources: {'Port': ['ID=19777011-5a23-4943-933c-9702ae0d11ce,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:00.136054 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:00.142663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] No DVR routers for this DVR port 19777011-5a23-4943-933c-9702ae0d11ce on host dv-cinder-817417-1-iscsi {{(pid=88328) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:52:00.196086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] For port 19777011-5a23-4943-933c-9702ae0d11ce, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=19777011-5a23-4943-933c-9702ae0d11ce,segment=NetworkSegment(421843b6-0528-41c4-b114-9384539ecc53),segment_id=421843b6-0528-41c4-b114-9384539ecc53)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:00.197050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:00.292438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:00.328678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['95fd47ac-3c3a-4852-88d6-8eed6cc12159']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:00.345302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '421843b6-0528-41c4-b114-9384539ecc53') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:00.345629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '421843b6-0528-41c4-b114-9384539ecc53') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:00.355607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] Calling delete_port for 19777011-5a23-4943-933c-9702ae0d11ce owned by network:dhcp {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:52:00.360500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:00.378117 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:00.386342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Releasing vlan 1022 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:52:00.386793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:52:00.402511 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:52:00.433383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:52:00.433792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:52:00.441373 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a550f720-a428-4508-8c68-8cfd75db4eb7 req-5013e11a-7f59-4c7f-b405-9ff5d110ae63 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:00.443064 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a550f720-a428-4508-8c68-8cfd75db4eb7 req-5013e11a-7f59-4c7f-b405-9ff5d110ae63 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 950 time: 0.0983064 Nov 11 11:52:00.494106 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a550f720-a428-4508-8c68-8cfd75db4eb7 req-7030bc37-3cbf-4057-8e1b-f5d047748a83 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443866 Nov 11 11:52:00.619994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:00.625532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:00.628291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:00.743956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 19777011-5a23-4943-933c-9702ae0d11ce no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:52:00.778345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 19777011-5a23-4943-933c-9702ae0d11ce {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:52:00.778736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 19777011-5a23-4943-933c-9702ae0d11ce not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:52:00.779256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:52:00.817534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:52:00.817925 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 5eadec18-337a-4eb6-aa8f-d9d1a9f98039 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:52:00.876427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Pushing event deleted for resources: {'Network': ['ID=95fd47ac-3c3a-4852-88d6-8eed6cc12159,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:00.881590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:00.918075 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] 10.222.0.11 "DELETE /v2.0/networks/95fd47ac-3c3a-4852-88d6-8eed6cc12159 HTTP/1.1" status: 204 len: 168 time: 1.4865129 Nov 11 11:52:00.934818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] Deleting port 19777011-5a23-4943-933c-9702ae0d11ce {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:52:00.935258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:01.001342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f86fc7e5-63bb-4e4c-ae5e-157db1ab71f0 None None] The port '19777011-5a23-4943-933c-9702ae0d11ce' was deleted {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1877}} Nov 11 11:52:01.158797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39768) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:01.212395 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2bd33fd4-f851-41ff-90ee-fdaa65f7fec5 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=49b88e3cf8f748be91f37e0b9caccf6d&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0521851 Nov 11 11:52:01.214992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39772) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:01.277671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12d16ae7-b13a-48ff-87a6-8096fcd00f4e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:01.304614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12d16ae7-b13a-48ff-87a6-8096fcd00f4e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:01.379592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12d16ae7-b13a-48ff-87a6-8096fcd00f4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:01.384640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f9687ea9-938c-49d2-8ac5-2ad39e68d513 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:01.400733 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d16ae7-b13a-48ff-87a6-8096fcd00f4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1e88d09-ccec-4ca3-b694-06c4b4f9cd28,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:01.403863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-12d16ae7-b13a-48ff-87a6-8096fcd00f4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:01.405948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12d16ae7-b13a-48ff-87a6-8096fcd00f4e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:01.408443 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-12d16ae7-b13a-48ff-87a6-8096fcd00f4e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b1e88d09-ccec-4ca3-b694-06c4b4f9cd28 HTTP/1.1" status: 204 len: 168 time: 0.1911533 Nov 11 11:52:01.749398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3b05c52-62d7-4eea-9d23-bd127fef2b34 req-7994f95f-78f7-4977-99a4-23ae2de53dc3 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:01.751029 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3b05c52-62d7-4eea-9d23-bd127fef2b34 req-7994f95f-78f7-4977-99a4-23ae2de53dc3 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 950 time: 0.1207485 Nov 11 11:52:01.827606 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3b05c52-62d7-4eea-9d23-bd127fef2b34 req-b69ca776-faf9-4963-930f-42a6a818baf8 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/security-groups?id=b624ee76-b4ef-47aa-834a-1dec64b70404&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674670 Nov 11 11:52:01.836697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81377d69-52c4-4d4e-a315-0f426c524835 req-a0fbf6ee-1651-4ccb-b82a-37cc46eeaaad tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:01.838228 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-81377d69-52c4-4d4e-a315-0f426c524835 req-a0fbf6ee-1651-4ccb-b82a-37cc46eeaaad tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.60 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 950 time: 0.1334963 Nov 11 11:52:01.925264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Deleting port 4def8f29-7e3f-49b7-b1f2-af1af852e924 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:52:01.925825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:02.197143 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] For port 4def8f29-7e3f-49b7-b1f2-af1af852e924, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=4def8f29-7e3f-49b7-b1f2-af1af852e924,segment=NetworkSegment(c7e3cfb8-478a-49a8-8a62-e44b81ddec99),segment_id=c7e3cfb8-478a-49a8-8a62-e44b81ddec99)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:02.197549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:02.332984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Calling delete_port for 4def8f29-7e3f-49b7-b1f2-af1af852e924 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:52:02.499723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:02.500137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 39796) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:02.507124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6efc1185-d3ac-4b99-91b3-9bed2ba0be0b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:02.511581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['4def8f29-7e3f-49b7-b1f2-af1af852e924'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:52:02.554406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Pushing event deleted for resources: {'Port': ['ID=4def8f29-7e3f-49b7-b1f2-af1af852e924,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:02.604446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.604931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.605255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.605695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.606019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.606415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.606779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.607185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.607578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.607997 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.608386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:02.612012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:02.651212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] No DVR routers for this DVR port 4def8f29-7e3f-49b7-b1f2-af1af852e924 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:52:02.653844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:02.658939 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '667d9c4c-eae8-4553-9f69-edc322b4f934', 'name': 'network-vif-deleted', 'tag': '4def8f29-7e3f-49b7-b1f2-af1af852e924'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:52:02.670343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-903013398-network', 'tenant_id': '9c2955dc91344feaaa33bc192608a822'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:02.677580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:02.682363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Usage tracker for resource:network and tenant:9c2955dc91344feaaa33bc192608a822 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:02.685915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:02.693479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:02.700900 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-81377d69-52c4-4d4e-a315-0f426c524835 req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.60 "DELETE /v2.0/ports/4def8f29-7e3f-49b7-b1f2-af1af852e924 HTTP/1.1" status: 204 len: 173 time: 0.8568101 Nov 11 11:52:02.716765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Made reservation on behalf of 9c2955dc91344feaaa33bc192608a822 for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:02.722796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:02.736982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:02.777434 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:02.782216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Usage tracker for resource:security_group_rule and tenant:9c2955dc91344feaaa33bc192608a822 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:02.799961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:02.812367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:02.916613 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '667d9c4c-eae8-4553-9f69-edc322b4f934', 'name': 'network-vif-deleted', 'tag': '4def8f29-7e3f-49b7-b1f2-af1af852e924', 'status': 'completed', 'code': 200} Nov 11 11:52:02.990937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:03.018673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7e499d89-0d5b-401e-8b8a-ac89c55ffdf6 req-cd2e7508-9036-4504-97dc-db48b68a6941 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Synchronizing usage tracker for tenant:9c8b52a8fc514d4a8645074916ba1628 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:52:03.019924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:03.024536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ab1a7cb3-ee45-40a5-b562-f3cb54f22989 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:03.052291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1024} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:52:03.066132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18a87f4b-de66-4ce5-b408-48f15635a0bb,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:03.069128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:03.082525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7e499d89-0d5b-401e-8b8a-ac89c55ffdf6 req-cd2e7508-9036-4504-97dc-db48b68a6941 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Unset dirty status for tenant:9c8b52a8fc514d4a8645074916ba1628 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:52:03.083846 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7e499d89-0d5b-401e-8b8a-ac89c55ffdf6 req-cd2e7508-9036-4504-97dc-db48b68a6941 tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] 10.222.0.11 "GET /v2.0/ports?device_id=667d9c4c-eae8-4553-9f69-edc322b4f934 HTTP/1.1" status: 200 len: 210 time: 0.1155269 Nov 11 11:52:03.113482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:03.113887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Added segment 48b3fee6-4c38-4975-aea7-8c618366f035 of type vlan for network b92aaf3b-0783-47c5-8158-f0c34b4d4466 Nov 11 11:52:03.190871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:03.282580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:03.283986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:03.284685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:03.290148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:03.398401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Pushing event updated for resources: {'Network': ['ID=b92aaf3b-0783-47c5-8158-f0c34b4d4466,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:03.401300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:03.409932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network b92aaf3b-0783-47c5-8158-f0c34b4d4466 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:52:03.452351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 39810) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:03.452593 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.9510901 Nov 11 11:52:03.459688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Request body: {'subnet': {'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-903013398-subnet', 'tenant_id': '9c2955dc91344feaaa33bc192608a822', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:03.465059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:03.470295 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Usage tracker for resource:subnet and tenant:9c2955dc91344feaaa33bc192608a822 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:03.473795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:03.480188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:03.517782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Made reservation on behalf of 9c2955dc91344feaaa33bc192608a822 for: {'subnet': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:03.524116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2758763'] for subnet, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:03.922803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2720250', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2758778'] for subnet, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:03.927681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-49d6265c-41f1-43de-93a1-1cbf950f1ca2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:04.006323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Pushing event updated for resources: {'Subnet': ['ID=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:04.010507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:04.019402 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Checking segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:04.019796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Network hostable DHCP agents. Network: b92aaf3b-0783-47c5-8158-f0c34b4d4466, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88329) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:52:04.088629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Network b92aaf3b-0783-47c5-8158-f0c34b4d4466 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88329) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:52:04.117919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, b92aaf3b-0783-47c5-8158-f0c34b4d4466) {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:04.122196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:04.122847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:04.129457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-860e8f20-7a1e-4f43-a26d-929880c09f5c None None] Network b92aaf3b-0783-47c5-8158-f0c34b4d4466 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:52:04.163681 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-7012d136-b8f1-4f2f-831e-33bb00d3af84 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.7091293 Nov 11 11:52:04.367692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf1ecce3-ad16-4ed0-97d7-9c94d210d3d9 None None] Network b92aaf3b-0783-47c5-8158-f0c34b4d4466 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:52:04.648670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:04.697215 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e10751-7845-41cf-b152-5155634bfb24 req-4fa2913e-4fa9-48f8-a85b-344dda544cdf tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:04.698796 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-4fa2913e-4fa9-48f8-a85b-344dda544cdf tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 814 time: 0.1576500 Nov 11 11:52:04.717598 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-7bd82b22-2ac5-46cf-a56a-eadab989e35e tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/quotas/9c2955dc91344feaaa33bc192608a822 HTTP/1.1" status: 200 len: 375 time: 0.0117726 Nov 11 11:52:04.768345 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-b27787b2-a56c-4a09-9ac4-c4fb19907328 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0439169 Nov 11 11:52:04.858869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-c4ba4b7a-5b8b-4527-899b-aa1eeba0a220 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:52:04.859988 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-c4ba4b7a-5b8b-4527-899b-aa1eeba0a220 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.0845759 Nov 11 11:52:05.004070 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-61248445-0c6f-414b-afa3-d56453527676 service neutron] 10.222.0.11 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1369832 Nov 11 11:52:05.151673 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-46c3965b-5fdf-498c-9929-674c1d52263e service neutron] 10.222.0.11 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1409113 Nov 11 11:52:05.471508 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-44579526-502b-4506-9382-a1efdbf46de4 req-a6e75393-bef9-4623-9265-c35f0715e092 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 210 time: 0.0528553 Nov 11 11:52:06.244573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 4def8f29-7e3f-49b7-b1f2-af1af852e924 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:52:06.282155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 4def8f29-7e3f-49b7-b1f2-af1af852e924 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:52:06.282545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 4def8f29-7e3f-49b7-b1f2-af1af852e924 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:52:06.727273 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fbe272b6-e093-42d6-8ed8-6855164ec4c3 req-d58467d1-730e-4a75-a59d-45fe1a8ba960 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 210 time: 0.0455830 Nov 11 11:52:07.933922 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-78739b54-978c-4532-9ad2-0802223aace1 req-8fc37b7f-24aa-4c3d-8f02-3827edb687af tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 210 time: 0.0611989 Nov 11 11:52:07.939680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e10751-7845-41cf-b152-5155634bfb24 req-93573e49-bd43-4280-b952-d3c25221e4c5 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:07.940995 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-93573e49-bd43-4280-b952-d3c25221e4c5 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 814 time: 0.4447479 Nov 11 11:52:07.963420 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Request body: {'port': {'device_id': '4dac1f21-d5f2-44cf-823e-5ed387668e02', 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'admin_state_up': True, 'tenant_id': '9c2955dc91344feaaa33bc192608a822'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:08.109082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:08.113731 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Usage tracker for resource:port and tenant:9c2955dc91344feaaa33bc192608a822 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:08.116747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:08.122708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:08.157277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Made reservation on behalf of 9c2955dc91344feaaa33bc192608a822 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:08.163126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:08.336362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Allocated IP 172.20.0.8 (b92aaf3b-0783-47c5-8158-f0c34b4d4466/52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266/52672ac7-2b99-4bcd-8a42-9c6e53617d59) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:08.560003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:08.614232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:08.620446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e4261ce8-4cde-4b2b-b4a0-df04efca2673 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:08.699255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Network b92aaf3b-0783-47c5-8158-f0c34b4d4466 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:08.703686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:08.705756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Pushing event updated for resources: {'Port': ['ID=52672ac7-2b99-4bcd-8a42-9c6e53617d59,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:08.708170 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:08.740824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:08.774174 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:08.774763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:08.815190 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8565300 Nov 11 11:52:08.827096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Request body: {'port': {'device_id': '4dac1f21-d5f2-44cf-823e-5ed387668e02', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:08.946535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:09.289692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff58bf6-6541-47d9-8f88-cc61834da2dc req-97be05cf-9653-4941-a2fa-a99ea3753333 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:09.290506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-9ff58bf6-6541-47d9-8f88-cc61834da2dc req-97be05cf-9653-4941-a2fa-a99ea3753333 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Synchronizing usage tracker for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:52:09.382938 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-9ff58bf6-6541-47d9-8f88-cc61834da2dc req-97be05cf-9653-4941-a2fa-a99ea3753333 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Unset dirty status for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:52:09.384405 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9ff58bf6-6541-47d9-8f88-cc61834da2dc req-97be05cf-9653-4941-a2fa-a99ea3753333 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 931 time: 0.3139689 Nov 11 11:52:09.431723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 52672ac7-2b99-4bcd-8a42-9c6e53617d59 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:52:09.446968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:09.474166 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9ff58bf6-6541-47d9-8f88-cc61834da2dc req-ad8255aa-e74c-451f-aeb4-1d05804a636d tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822594 Nov 11 11:52:09.475187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Transition to ACTIVE for port object 52672ac7-2b99-4bcd-8a42-9c6e53617d59 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:09.505726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:09.510885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e204ef80-ee8a-4fbe-a897-f068d7e54f9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:09.644982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Pushing event updated for resources: {'Port': ['ID=52672ac7-2b99-4bcd-8a42-9c6e53617d59,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:09.649971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:09.759482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Attempting to bind port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:52:09.759856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Attempting to bind port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:52:09.760227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Attempting to bind port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:09.766800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:52:09.767187 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Attempting to bind port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:09.773807 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:52:09.774575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Checking segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:09.774575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Bound using segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:52:09.775046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Bound port: 52672ac7-2b99-4bcd-8a42-9c6e53617d59, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:52:09.775459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:09.865852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] For port 52672ac7-2b99-4bcd-8a42-9c6e53617d59, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:52:09.869022 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] For port 52672ac7-2b99-4bcd-8a42-9c6e53617d59, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=52672ac7-2b99-4bcd-8a42-9c6e53617d59,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:52:09.894922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:09.899275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-20561c8e-7558-4125-8d81-dea4e64d6089 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:09.965512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:09.966782 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] 10.222.0.60 "PUT /v2.0/ports/52672ac7-2b99-4bcd-8a42-9c6e53617d59 HTTP/1.1" status: 200 len: 1093 time: 1.1443968 Nov 11 11:52:09.967360 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4dac1f21-d5f2-44cf-823e-5ed387668e02', 'tag': '52672ac7-2b99-4bcd-8a42-9c6e53617d59'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:52:09.992862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Pushing event updated for resources: {'Port': ['ID=52672ac7-2b99-4bcd-8a42-9c6e53617d59,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:09.996197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:10.019986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-39040d5e-0514-4daf-a17b-c805969793f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:10.022182 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4dac1f21-d5f2-44cf-823e-5ed387668e02', 'tag': '52672ac7-2b99-4bcd-8a42-9c6e53617d59', 'status': 'completed', 'code': 200} Nov 11 11:52:10.118406 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-38ee2353-c656-4bbe-9485-90d55d923340 req-3f41e9df-e7d4-4475-a3ce-8779daab5329 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 1096 time: 0.0760586 Nov 11 11:52:10.274183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ee2353-c656-4bbe-9485-90d55d923340 req-3578b4f9-2458-4b72-9e78-d42b377eb36d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:10.275793 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-38ee2353-c656-4bbe-9485-90d55d923340 req-3578b4f9-2458-4b72-9e78-d42b377eb36d service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=9c2955dc91344feaaa33bc192608a822&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1500096 Nov 11 11:52:10.425833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ee2353-c656-4bbe-9485-90d55d923340 req-d49ccce5-d9ca-4597-9df1-34311a0b0a7f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:10.427579 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-38ee2353-c656-4bbe-9485-90d55d923340 req-d49ccce5-d9ca-4597-9df1-34311a0b0a7f service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1453838 Nov 11 11:52:10.545391 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-836e1b21-fb23-4b92-b012-6362f343b9af service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 1096 time: 0.0830750 Nov 11 11:52:10.669661 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-52eb7873-168b-4131-8b45-228bf482dc29 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=52672ac7-2b99-4bcd-8a42-9c6e53617d59 HTTP/1.1" status: 200 len: 217 time: 0.1170127 Nov 11 11:52:10.741000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40108) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:10.761333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e10751-7845-41cf-b152-5155634bfb24 req-7a011acf-faa5-4f08-a541-bc6a8c896370 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:10.762988 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-7a011acf-faa5-4f08-a541-bc6a8c896370 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 HTTP/1.1" status: 200 len: 854 time: 0.0858960 Nov 11 11:52:10.769552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d6115c-e7aa-4291-8034-bcd398a7b2b7 req-898619e1-6286-4588-ba04-47613dcc6f17 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:10.771251 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-06d6115c-e7aa-4291-8034-bcd398a7b2b7 req-898619e1-6286-4588-ba04-47613dcc6f17 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 943 time: 0.1587560 Nov 11 11:52:10.829532 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-01c44265-a291-4374-9554-93c814113882 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=b92aaf3b-0783-47c5-8158-f0c34b4d4466&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0573907 Nov 11 11:52:10.932367 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9a71ee48-26e4-43c8-a8fe-2d8096f4af7b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9c8b52a8fc514d4a8645074916ba1628&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1899445 Nov 11 11:52:10.935120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40114) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:10.961138 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-06d6115c-e7aa-4291-8034-bcd398a7b2b7 req-cf8395be-db68-4566-aecc-ea3408d1b604 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1518292 Nov 11 11:52:10.996533 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-eafc9d87-e337-410b-9dce-d243557075fc service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1610291 Nov 11 11:52:11.006273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fa1ddbb3-bde0-4913-b8ca-9008b91f5052 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:11.038143 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fa1ddbb3-bde0-4913-b8ca-9008b91f5052 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:11.116487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fa1ddbb3-bde0-4913-b8ca-9008b91f5052 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:11.121750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-60fcbe02-09ee-4276-9df1-e89662874a04 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:11.135835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa1ddbb3-bde0-4913-b8ca-9008b91f5052 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b624ee76-b4ef-47aa-834a-1dec64b70404,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:11.138671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fa1ddbb3-bde0-4913-b8ca-9008b91f5052 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:11.144286 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9e10751-7845-41cf-b152-5155634bfb24 req-af8d5237-fccf-4d57-84ca-c0c7d502e8f5 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1418228 Nov 11 11:52:11.173945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fa1ddbb3-bde0-4913-b8ca-9008b91f5052 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:11.175577 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-fa1ddbb3-bde0-4913-b8ca-9008b91f5052 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b624ee76-b4ef-47aa-834a-1dec64b70404 HTTP/1.1" status: 204 len: 168 time: 0.2389412 Nov 11 11:52:11.265116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:12.179031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-959ab048-05e1-448d-82b3-3c9dac2c8130 req-0f56ff3b-4278-4edf-9f62-a919886f3909 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:12.180588 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-959ab048-05e1-448d-82b3-3c9dac2c8130 req-0f56ff3b-4278-4edf-9f62-a919886f3909 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 943 time: 0.0898905 Nov 11 11:52:12.193500 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40138) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:12.230808 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-959ab048-05e1-448d-82b3-3c9dac2c8130 req-74d18080-423d-425c-8d31-e4a5fc69622b tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439296 Nov 11 11:52:12.335414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1781542400-network', 'tenant_id': '08033101aa064f2da647814019558d4e'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:12.340460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:12.345129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Usage tracker for resource:network and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:12.348370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:12.354280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:12.402422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Made reservation on behalf of 08033101aa064f2da647814019558d4e for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:12.407787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:12.420923 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:12.509291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:12.513524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Usage tracker for resource:security_group_rule and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:12.516665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:12.522797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:12.851583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:12.882325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:12.886641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-10f8dc76-9799-492e-adf9-620150de7b01 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:12.911978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1043} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:52:12.927032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=091599ea-1d12-4fa6-b21a-4de8f0f3d035,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:12.931404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:12.932411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:12.932803 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Added segment 79ee61d3-8883-4921-b5ea-a86abe95cc2c of type vlan for network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 Nov 11 11:52:12.960103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.019591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.020859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:13.021489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.026603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b00c8445-8d35-4bf3-b82b-ef65f128a65d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:13.133031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Pushing event updated for resources: {'Network': ['ID=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:13.133031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:13.140000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:52:13.152934 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.9579928 Nov 11 11:52:13.158531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40144) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:13.164843 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Request body: {'subnet': {'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1781542400-subnet', 'tenant_id': '08033101aa064f2da647814019558d4e', 'ip_version': 4}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:13.171105 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:13.176206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Usage tracker for resource:subnet and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:13.179366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:13.185448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:13.219877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Made reservation on behalf of 08033101aa064f2da647814019558d4e for: {'subnet': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:13.224953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2758763'] for subnet, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.465478 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f47804d4-27ce-4211-9de5-61b4698c8f8d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.500764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.514378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b93f745-4e85-4eb8-889d-3c5bb03f491f req-5ce559b0-0da8-46c2-a374-e0f88bd858d4 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:13.517353 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b93f745-4e85-4eb8-889d-3c5bb03f491f req-5ce559b0-0da8-46c2-a374-e0f88bd858d4 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 943 time: 0.1380715 Nov 11 11:52:13.518765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2720250', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2758778'] for subnet, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.523209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:13.633165 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=74c32ff7-aa8c-4ebd-bce0-516dac9bf326,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:13.641554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:13.648703 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8b93f745-4e85-4eb8-889d-3c5bb03f491f req-48316150-5e8b-4195-b35f-c73eb22294f8 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0988019 Nov 11 11:52:13.656062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Checking segment: {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:13.656446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Network hostable DHCP agents. Network: 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88329) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:52:13.699330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88329) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:52:13.722879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4) {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:13.727017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:13.727615 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.732275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6443918-82a3-4df4-8c85-72530297a5df None None] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:52:13.769534 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6c28070c-7892-4ad7-acec-c2c993586ff6 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6097305 Nov 11 11:52:13.772404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40150) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:13.779247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:13.785445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:13.789714 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Usage tracker for resource:router and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:13.792846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:13.800232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:13.831718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.832747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.907854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:13.991089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:52:13.992039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:14.100826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:14.167886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Allocated IP 172.20.0.2 (16848b15-b078-4b3f-a9fe-4cd0b9fefdf4/74c32ff7-aa8c-4ebd-bce0-516dac9bf326/615d9db4-7679-47e3-9b84-646aaf1c900f) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:14.317888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 52672ac7-2b99-4bcd-8a42-9c6e53617d59 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:52:14.327709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:14.364800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:14.432301 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:14.501681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Transition to ACTIVE for port object 615d9db4-7679-47e3-9b84-646aaf1c900f will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:14.557446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 52672ac7-2b99-4bcd-8a42-9c6e53617d59, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=52672ac7-2b99-4bcd-8a42-9c6e53617d59,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:14.563845 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Allocated IP 172.27.3.26 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/2bbb36ec-229e-423a-b6a6-4cce3c397610) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:14.565976 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Transition to ACTIVE for port object 615d9db4-7679-47e3-9b84-646aaf1c900f will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:14.574526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '52672ac7-2b99-4bcd-8a42-9c6e53617d59', 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'port_id': '52672ac7-2b99-4bcd-8a42-9c6e53617d59', 'mac_address': 'fa:16:3e:bc:fc:80', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1024, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:52:14.613139 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:14.619870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:14.703808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:14.887395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:14.888557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:14.895959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:14.899210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Pushing event updated for resources: {'Port': ['ID=615d9db4-7679-47e3-9b84-646aaf1c900f,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:14.907367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.283s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:14.907367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 52672ac7-2b99-4bcd-8a42-9c6e53617d59 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:52:14.941623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a833098d-bfeb-486a-b0b2-0687a0aab3fd req-b0ac5bc5-0d90-4555-9a9e-37e62161b87d tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:14.943500 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a833098d-bfeb-486a-b0b2-0687a0aab3fd req-b0ac5bc5-0d90-4555-9a9e-37e62161b87d tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 943 time: 0.0994890 Nov 11 11:52:14.948498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:14.983740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 52672ac7-2b99-4bcd-8a42-9c6e53617d59, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=52672ac7-2b99-4bcd-8a42-9c6e53617d59,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:14.984911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:15.006245 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a833098d-bfeb-486a-b0b2-0687a0aab3fd req-3d21f8f1-3a9b-464d-8e6c-cda6d2bf6b01 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546622 Nov 11 11:52:15.011989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Attempting to bind port 615d9db4-7679-47e3-9b84-646aaf1c900f on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:52:15.012491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Attempting to bind port 615d9db4-7679-47e3-9b84-646aaf1c900f by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:52:15.012941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Attempting to bind port 615d9db4-7679-47e3-9b84-646aaf1c900f on network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:15.021045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:52:15.021464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Checking segment: {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:15.021899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:15.022342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Bound using segment: {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:52:15.022936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Bound port: 615d9db4-7679-47e3-9b84-646aaf1c900f, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:52:15.023288 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:15.035787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:15.041421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:15.060218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:15.065083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e619a460-2bc1-491e-874f-ef18b34a23c0 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:15.135605 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:15.139474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:15.144078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:15.168106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=52672ac7-2b99-4bcd-8a42-9c6e53617d59,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:15.170492 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Pushing event updated for resources: {'Port': ['ID=2bbb36ec-229e-423a-b6a6-4cce3c397610,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:15.173346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:15.176621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:15.183046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] For port 615d9db4-7679-47e3-9b84-646aaf1c900f, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:52:15.186348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] For port 615d9db4-7679-47e3-9b84-646aaf1c900f, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=615d9db4-7679-47e3-9b84-646aaf1c900f,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:52:15.220589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:15.224889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-61adfd53-750a-494f-9cb9-c5d1131e5538 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:15.328589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Pushing event updated for resources: {'Port': ['ID=615d9db4-7679-47e3-9b84-646aaf1c900f,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:15.331652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:15.397024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['52672ac7-2b99-4bcd-8a42-9c6e53617d59'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:52:15.412977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:15.413763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:15.711540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Router 513d8c63-d622-434a-a3e7-a65baed1396c is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88328) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:52:15.932249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:52:15.943899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Sync routers for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:52:15.965476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:15.966608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:16.008735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:16.010107 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b6b47fb9-a185-4889-8450-9b581e2e5c43 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.2363522 Nov 11 11:52:16.012994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40156) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:16.166522 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:16.240191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff5a890-7bce-4555-8311-7e5c28a9f4a0 req-0bef39ff-7d43-455c-95cc-67596563a91a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:16.241806 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4ff5a890-7bce-4555-8311-7e5c28a9f4a0 req-0bef39ff-7d43-455c-95cc-67596563a91a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 944 time: 0.1058707 Nov 11 11:52:16.307926 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4ff5a890-7bce-4555-8311-7e5c28a9f4a0 req-d3e5d16e-1214-4b23-be6d-03b199f2c1a1 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593238 Nov 11 11:52:16.375254 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 52672ac7-2b99-4bcd-8a42-9c6e53617d59 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:16.550917 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:15Z', 'revision_number': 3, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:16.554472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:16.560063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Checking router: 513d8c63-d622-434a-a3e7-a65baed1396c for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:52:16.560476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Updating router 513d8c63-d622-434a-a3e7-a65baed1396c port 2bbb36ec-229e-423a-b6a6-4cce3c397610 binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:52:16.589518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:16.589889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:16.668772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:16.830042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 615d9db4-7679-47e3-9b84-646aaf1c900f up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:16.917108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:16.922270 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-10061a2c-5a2d-4422-90f4-7444bf4e2e71 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0964513 Nov 11 11:52:17.024204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4dac1f21-d5f2-44cf-823e-5ed387668e02', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '52672ac7-2b99-4bcd-8a42-9c6e53617d59'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:52:17.047666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 52672ac7-2b99-4bcd-8a42-9c6e53617d59, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=52672ac7-2b99-4bcd-8a42-9c6e53617d59,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:17.062576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:17.114327 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-13aa5447-5e19-4534-ba22-744262f23394 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 1098 time: 0.1088934 Nov 11 11:52:17.115894 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4dac1f21-d5f2-44cf-823e-5ed387668e02', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '52672ac7-2b99-4bcd-8a42-9c6e53617d59', 'code': 200} Nov 11 11:52:17.117422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:17.121257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a02a6b5-7a54-4ed3-9aa2-5c7294f87ccc None None] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:52:17.142868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:17.210555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 615d9db4-7679-47e3-9b84-646aaf1c900f completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:17.288724 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-c5b65761-b634-4b46-a114-268e9d89c8fe service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:17.288724 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-c5b65761-b634-4b46-a114-268e9d89c8fe service neutron] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 914 time: 0.1532781 Nov 11 11:52:17.343081 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Allocated IP 172.20.0.1 (16848b15-b078-4b3f-a9fe-4cd0b9fefdf4/74c32ff7-aa8c-4ebd-bce0-516dac9bf326/d790e034-e84c-4036-8b48-d5440f2583a2) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:17.369953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=52672ac7-2b99-4bcd-8a42-9c6e53617d59,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:17.384637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:17.400329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] Provisioning for port 615d9db4-7679-47e3-9b84-646aaf1c900f completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:17.432681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] Provisioning complete for port 615d9db4-7679-47e3-9b84-646aaf1c900f triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:17.433138 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:17.568381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:17.589052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Transition to ACTIVE for port object d790e034-e84c-4036-8b48-d5440f2583a2 will not be triggered until provisioned by entity DHCP. {{(pid=88328) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:17.638922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:17.645989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:17.724800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:17.729086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Pushing event updated for resources: {'Port': ['ID=d790e034-e84c-4036-8b48-d5440f2583a2,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:17.732583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:17.733703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:17.736212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:17.794231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:17.935034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:17.974267 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-6829223f-4977-4543-a856-7578e7967231 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde HTTP/1.1" status: 200 len: 1001 time: 0.6797261 Nov 11 11:52:18.005331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.061371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Transition to ACTIVE for port object 2bbb36ec-229e-423a-b6a6-4cce3c397610 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:18.139425 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8eebedf5-14f4-4a11-810a-f9782cb07f0d req-9e82ec1f-367d-470b-a97e-50c950c8cd17 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 1098 time: 0.7699888 Nov 11 11:52:18.155478 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-179c9455-4167-499a-a23b-9d9d487fb852 req-fc07b857-35af-482d-8004-ee6c3777b86b tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:18.158614 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-179c9455-4167-499a-a23b-9d9d487fb852 req-fc07b857-35af-482d-8004-ee6c3777b86b tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 945 time: 0.3500476 Nov 11 11:52:18.166940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.179563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7508bb5a-52a8-4a40-9076-fa5171544aa8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:18.180204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.213885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.233190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-3f42eb86-4f25-4add-b735-085ca6b22a3d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:18.235831 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-3f42eb86-4f25-4add-b735-085ca6b22a3d service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.2502592 Nov 11 11:52:18.244063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:18.261817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.333825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.338558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Pushing event updated for resources: {'Port': ['ID=d790e034-e84c-4036-8b48-d5440f2583a2,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:18.342163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:18.370278 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8eebedf5-14f4-4a11-810a-f9782cb07f0d req-5e96c2a3-0b08-412b-b972-f2fdd5a398e7 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2099884 Nov 11 11:52:18.396218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2383ad-b88f-44a2-8d2e-c50645bc3b1b None None] Pushing event updated for resources: {'Port': ['ID=2bbb36ec-229e-423a-b6a6-4cce3c397610,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:18.400261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Attempting to bind port 2bbb36ec-229e-423a-b6a6-4cce3c397610 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:52:18.400689 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Attempting to bind port 2bbb36ec-229e-423a-b6a6-4cce3c397610 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:52:18.401312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Attempting to bind port 2bbb36ec-229e-423a-b6a6-4cce3c397610 on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:18.405613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2d2383ad-b88f-44a2-8d2e-c50645bc3b1b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:18.410511 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-179c9455-4167-499a-a23b-9d9d487fb852 req-f4ab7720-d7c9-4f00-b9b6-c239c606df27 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2449796 Nov 11 11:52:18.412293 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] For port 615d9db4-7679-47e3-9b84-646aaf1c900f, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=615d9db4-7679-47e3-9b84-646aaf1c900f,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:18.413847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:52:18.414261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:18.414706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.415140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:52:18.417190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Bound port: 2bbb36ec-229e-423a-b6a6-4cce3c397610, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:52:18.417617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.445561 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-1b687887-6a8b-4486-9195-69e68c8db9e8 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2014840 Nov 11 11:52:18.450001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.461223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:18.504318 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:18.505571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:18.562771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] Pushing event updated for resources: {'Port': ['ID=615d9db4-7679-47e3-9b84-646aaf1c900f,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:18.566215 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] For port 2bbb36ec-229e-423a-b6a6-4cce3c397610, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:52:18.568852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:18.570599 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] For port 2bbb36ec-229e-423a-b6a6-4cce3c397610, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=2bbb36ec-229e-423a-b6a6-4cce3c397610,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:52:18.631513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.636340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:18.730423 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2383ad-b88f-44a2-8d2e-c50645bc3b1b None None] Pushing event updated for resources: {'Port': ['ID=2bbb36ec-229e-423a-b6a6-4cce3c397610,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:18.735212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2d2383ad-b88f-44a2-8d2e-c50645bc3b1b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:18.737325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:18.737510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:18.744672 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-f3e4fafb-ff82-4042-bb72-773a9fe738c1 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1539822 Nov 11 11:52:18.817152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 615d9db4-7679-47e3-9b84-646aaf1c900f up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:18.915582 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc2da3ff-70dd-4c6f-9040-5c211029dc38 req-7dd0574f-03d7-4395-8f2d-d348dc695540 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1554224 Nov 11 11:52:18.977265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e4659eeb-f019-4b78-849e-9970e9c0efc4 None None] Provisioning for port d790e034-e84c-4036-8b48-d5440f2583a2 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:18.990267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e4659eeb-f019-4b78-849e-9970e9c0efc4 None None] Provisioning complete for port d790e034-e84c-4036-8b48-d5440f2583a2 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:18.990584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4659eeb-f019-4b78-849e-9970e9c0efc4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:18.994265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Router 513d8c63-d622-434a-a3e7-a65baed1396c has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:52:19.090023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e4659eeb-f019-4b78-849e-9970e9c0efc4 None None] Port d790e034-e84c-4036-8b48-d5440f2583a2 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:52:19.094648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:19.135464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 615d9db4-7679-47e3-9b84-646aaf1c900f triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:19.135889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:19.215140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:52:19.226082 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] 10.222.0.11 "PUT /v2.0/routers/513d8c63-d622-434a-a3e7-a65baed1396c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2119002 Nov 11 11:52:19.290331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e4659eeb-f019-4b78-849e-9970e9c0efc4 None None] Provisioning complete for port 615d9db4-7679-47e3-9b84-646aaf1c900f triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:19.290755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e4659eeb-f019-4b78-849e-9970e9c0efc4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:19.649825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edfc06ac-b292-4f6d-972c-94197be12885 req-abc4abd7-5f06-43e5-b070-1bdad87b6fb3 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:19.651569 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-edfc06ac-b292-4f6d-972c-94197be12885 req-abc4abd7-5f06-43e5-b070-1bdad87b6fb3 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 945 time: 0.0907023 Nov 11 11:52:19.708763 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-edfc06ac-b292-4f6d-972c-94197be12885 req-06bddc3d-edf2-4001-84b6-edc4848ca768 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505259 Nov 11 11:52:19.711005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:18Z', 'revision_number': 2, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:19.715467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df2c107a-78dc-495b-87a7-996408e9b86f None None] The sync data for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi is: [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:18Z', 'revision_number': 2, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:52:19.795137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-d573d028-9c4d-4214-ab8d-f6be8dd3bb78 None None] Provisioning complete for port d790e034-e84c-4036-8b48-d5440f2583a2 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:19.795642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d573d028-9c4d-4214-ab8d-f6be8dd3bb78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:19.853847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-d573d028-9c4d-4214-ab8d-f6be8dd3bb78 None None] Port d790e034-e84c-4036-8b48-d5440f2583a2 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:52:20.340342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40186) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:20.347350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1102472099-network', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:20.352574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:20.356692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Usage tracker for resource:network and tenant:70fe58003dfc4c6e90cc8f7f1ec717bc is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:20.360480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:20.366899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:20.402590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Made reservation on behalf of 70fe58003dfc4c6e90cc8f7f1ec717bc for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:20.407710 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.421829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.458310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:20.462703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Usage tracker for resource:security_group_rule and tenant:70fe58003dfc4c6e90cc8f7f1ec717bc is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:20.465967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:20.472667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:20.547191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.574013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.577687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dce174b4-519f-4660-910e-4dfec9458d15 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:20.613496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1012} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:52:20.619495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73c980e6-4b2d-4c40-9844-f9a5b1727ecc,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:20.623496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:20.656516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.657039 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Added segment 182819e1-eced-44cf-a263-baf3680de8cd of type vlan for network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 Nov 11 11:52:20.765554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.819306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 2bbb36ec-229e-423a-b6a6-4cce3c397610 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:20.865576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.866955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:20.868129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.882629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:20.928503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 2bbb36ec-229e-423a-b6a6-4cce3c397610 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:20.940564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 2bbb36ec-229e-423a-b6a6-4cce3c397610 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:20.940564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:20.959895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40dca0aa-61d4-4fcb-883f-f2f28b8fc946 req-332a5603-8cff-47b7-91ad-3133c821b4e1 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:20.968005 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40dca0aa-61d4-4fcb-883f-f2f28b8fc946 req-332a5603-8cff-47b7-91ad-3133c821b4e1 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 945 time: 0.1077104 Nov 11 11:52:20.986873 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.6452887 Nov 11 11:52:20.987965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40192) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:21.003619 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Request body: {'subnet': {'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1102472099-subnet', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:21.009970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:21.014545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Usage tracker for resource:subnet and tenant:70fe58003dfc4c6e90cc8f7f1ec717bc is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:21.017594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:21.024319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:21.031811 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40dca0aa-61d4-4fcb-883f-f2f28b8fc946 req-4bd76d4e-79bd-4aaa-964d-3a3db4825454 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617740 Nov 11 11:52:21.034023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Pushing event updated for resources: {'Network': ['ID=3cb5b798-18d5-4595-82ee-1dd6b771d7c6,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:21.037194 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:21.051531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:52:21.065875 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Made reservation on behalf of 70fe58003dfc4c6e90cc8f7f1ec717bc for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:21.072461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036852136936'] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:21.163169 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:21.192243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 2bbb36ec-229e-423a-b6a6-4cce3c397610, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=2bbb36ec-229e-423a-b6a6-4cce3c397610,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:21.225975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:21.229060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7508bb5a-52a8-4a40-9076-fa5171544aa8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:21.309407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=2bbb36ec-229e-423a-b6a6-4cce3c397610,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:21.312901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:21.351130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created--9223372036852097580', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036852136951'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:21.356510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:21.436240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b9f6aa6-3f4b-453e-be0f-e3a7a1709027,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:21.441221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:21.450822 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Checking segment: {'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:21.451243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Network hostable DHCP agents. Network: 3cb5b798-18d5-4595-82ee-1dd6b771d7c6, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:52:21.523085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:52:21.603245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 3cb5b798-18d5-4595-82ee-1dd6b771d7c6) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:21.608159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:21.613420 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:21.614251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5809d9e3-6866-4e89-9f70-f011cea42be7 None None] Network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:52:21.668522 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6722522 Nov 11 11:52:21.669135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40200) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:21.675362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:21.683009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:21.688934 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Usage tracker for resource:router and tenant:70fe58003dfc4c6e90cc8f7f1ec717bc is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:21.692490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:21.700033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:21.741078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:21.742340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:21.771859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:21.957680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.025622 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-3cb5b798-18d5-4595-82ee-1dd6b771d7c6', 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'fixed_ips': [{'subnet_id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:52:22.026527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.192544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Allocated IP 172.20.0.2 (3cb5b798-18d5-4595-82ee-1dd6b771d7c6/4b9f6aa6-3f4b-453e-be0f-e3a7a1709027/7ccfa3dd-974b-4a20-adf7-40f06931d700) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:22.195306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.227482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.374910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Allocated IP 172.27.3.89 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/00cdaa72-3172-499d-8f32-783bc7f2ee2d) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:22.402466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.413761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Transition to ACTIVE for port object 7ccfa3dd-974b-4a20-adf7-40f06931d700 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:22.433333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Transition to ACTIVE for port object 7ccfa3dd-974b-4a20-adf7-40f06931d700 will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:22.483363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.492553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6070d129-e2fe-4915-90b5-a4c7bafb5e05 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:22.536965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.557929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:22.561683 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:22.566423 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:22.568749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Pushing event updated for resources: {'Port': ['ID=7ccfa3dd-974b-4a20-adf7-40f06931d700,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:22.571757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:22.585665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.590496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:22.662628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Attempting to bind port 7ccfa3dd-974b-4a20-adf7-40f06931d700 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:52:22.663037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Attempting to bind port 7ccfa3dd-974b-4a20-adf7-40f06931d700 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:52:22.663511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Attempting to bind port 7ccfa3dd-974b-4a20-adf7-40f06931d700 on network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:22.664793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:22.668757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Pushing event updated for resources: {'Port': ['ID=00cdaa72-3172-499d-8f32-783bc7f2ee2d,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:22.670687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:52:22.671227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Checking segment: {'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:22.672139 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:22.672254 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.672579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Bound using segment: {'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:52:22.673103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Bound port: 7ccfa3dd-974b-4a20-adf7-40f06931d700, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:52:22.673533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.674203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:22.674955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:22.766474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 2bbb36ec-229e-423a-b6a6-4cce3c397610 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:22.814725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] For port 7ccfa3dd-974b-4a20-adf7-40f06931d700, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:52:22.836045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] For port 7ccfa3dd-974b-4a20-adf7-40f06931d700, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=7ccfa3dd-974b-4a20-adf7-40f06931d700,segment=NetworkSegment(182819e1-eced-44cf-a263-baf3680de8cd),segment_id=182819e1-eced-44cf-a263-baf3680de8cd)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:52:22.856764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 2bbb36ec-229e-423a-b6a6-4cce3c397610 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:22.857337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.896292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:22.903527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2d2383ad-b88f-44a2-8d2e-c50645bc3b1b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:23.048740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Pushing event updated for resources: {'Port': ['ID=7ccfa3dd-974b-4a20-adf7-40f06931d700,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:23.053699 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:23.117441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:23.122370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:23.426980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Router 7a936485-2ecb-4134-b5b5-6475e0f27bda is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88328) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:52:23.610325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:52:23.679005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:52:23.685372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Sync routers for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:52:23.693005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Sync routers for ids ['7a936485-2ecb-4134-b5b5-6475e0f27bda'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:52:23.701311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:23.702260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:23.709044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Routers {'7a936485-2ecb-4134-b5b5-6475e0f27bda'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:23.709813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['7a936485-2ecb-4134-b5b5-6475e0f27bda'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:23.753184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:23.755617 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.0858037 Nov 11 11:52:23.758594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40218) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:23.913581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Set router 7a936485-2ecb-4134-b5b5-6475e0f27bda gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:24.055280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:24.253664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:52:23Z', 'revision_number': 3, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:24.258089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Checking router: 7a936485-2ecb-4134-b5b5-6475e0f27bda for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:52:24.258613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Updating router 7a936485-2ecb-4134-b5b5-6475e0f27bda port 00cdaa72-3172-499d-8f32-783bc7f2ee2d binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:52:24.319189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:24.442660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:18Z', 'revision_number': 2, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:24.448265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Checking router: 513d8c63-d622-434a-a3e7-a65baed1396c for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:52:24.448706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Updating router 513d8c63-d622-434a-a3e7-a65baed1396c port d790e034-e84c-4036-8b48-d5440f2583a2 binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:52:24.511318 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:24.665687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:24.735309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:24.758271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Transition to ACTIVE for port object 00cdaa72-3172-499d-8f32-783bc7f2ee2d will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:24.808607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:24.814975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-afe0ed29-2515-40c4-b5bc-2b3fd75fe608 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:24.901479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 7ccfa3dd-974b-4a20-adf7-40f06931d700 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:24.925866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4408a986-389d-4e10-b653-53a6fa6314be None None] Network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:52:24.996937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Allocated IP 172.20.0.1 (3cb5b798-18d5-4595-82ee-1dd6b771d7c6/4b9f6aa6-3f4b-453e-be0f-e3a7a1709027/bbc8dfae-2d86-42bc-83ae-aa71e1207685) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:25.099567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Attempting to bind port 00cdaa72-3172-499d-8f32-783bc7f2ee2d on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:52:25.099975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Attempting to bind port 00cdaa72-3172-499d-8f32-783bc7f2ee2d by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:52:25.100390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Attempting to bind port 00cdaa72-3172-499d-8f32-783bc7f2ee2d on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:25.114063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90b47402-d57e-4d9b-8cef-35595504c40d None None] Pushing event updated for resources: {'Port': ['ID=00cdaa72-3172-499d-8f32-783bc7f2ee2d,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:25.118356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-90b47402-d57e-4d9b-8cef-35595504c40d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:25.131667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:52:25.132030 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:25.132490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.132935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:52:25.133474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Bound port: 00cdaa72-3172-499d-8f32-783bc7f2ee2d, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:52:25.134278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.162203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.181873 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Transition to ACTIVE for port object d790e034-e84c-4036-8b48-d5440f2583a2 will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:25.184073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.184558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-d7d8e6d7-f59f-40bf-923f-3b6650b0c0de None None] Provisioning for port 7ccfa3dd-974b-4a20-adf7-40f06931d700 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:25.204720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Transition to ACTIVE for port object bbc8dfae-2d86-42bc-83ae-aa71e1207685 will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:25.219777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.224952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6524bb7f-aad0-4316-a251-202ebf172662 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:25.248524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.253955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cd610023-6a9c-4a8e-8664-d6f217e8248d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:25.290542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] For port 00cdaa72-3172-499d-8f32-783bc7f2ee2d, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:52:25.295971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] For port 00cdaa72-3172-499d-8f32-783bc7f2ee2d, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=00cdaa72-3172-499d-8f32-783bc7f2ee2d,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:52:25.323377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Pushing event updated for resources: {'Port': ['ID=bbc8dfae-2d86-42bc-83ae-aa71e1207685,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:25.326342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 7ccfa3dd-974b-4a20-adf7-40f06931d700 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:25.335216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:25.339444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 7ccfa3dd-974b-4a20-adf7-40f06931d700 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:25.339888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.344588 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:25.346061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:25.349610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:25.375970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.388290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:25.406157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Pushing event updated for resources: {'Port': ['ID=d790e034-e84c-4036-8b48-d5440f2583a2,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:25.411565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.449574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.449966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.450347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.450720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.451099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.451497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.451870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.452280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.453211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.454164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.454551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:25.463974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:25.513578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90b47402-d57e-4d9b-8cef-35595504c40d None None] Pushing event updated for resources: {'Port': ['ID=00cdaa72-3172-499d-8f32-783bc7f2ee2d,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:25.518611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-90b47402-d57e-4d9b-8cef-35595504c40d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:25.532064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Attempting to bind port d790e034-e84c-4036-8b48-d5440f2583a2 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:52:25.532559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Attempting to bind port d790e034-e84c-4036-8b48-d5440f2583a2 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:52:25.533033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Attempting to bind port d790e034-e84c-4036-8b48-d5440f2583a2 on network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:25.540766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.541224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:52:25.541721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Checking segment: {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:25.542238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.542736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Bound using segment: {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:52:25.543383 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Bound port: d790e034-e84c-4036-8b48-d5440f2583a2, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:52:25.543877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.602453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Routers {'7a936485-2ecb-4134-b5b5-6475e0f27bda'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:25.603203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['7a936485-2ecb-4134-b5b5-6475e0f27bda'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:25.684299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] For port d790e034-e84c-4036-8b48-d5440f2583a2, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:52:25.688545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] For port d790e034-e84c-4036-8b48-d5440f2583a2, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=d790e034-e84c-4036-8b48-d5440f2583a2,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:52:25.723432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.728611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-52f80f40-b56d-4d62-bc27-a9acff71d34f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:25.800719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.810796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Pushing event updated for resources: {'Port': ['ID=d790e034-e84c-4036-8b48-d5440f2583a2,revision_number=4']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:25.814625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:25.815716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:25.816228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:25.820845 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.877739 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:25.878749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 7ccfa3dd-974b-4a20-adf7-40f06931d700, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=7ccfa3dd-974b-4a20-adf7-40f06931d700,segment=NetworkSegment(182819e1-eced-44cf-a263-baf3680de8cd),segment_id=182819e1-eced-44cf-a263-baf3680de8cd)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:25.885595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] Set router 7a936485-2ecb-4134-b5b5-6475e0f27bda gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:25.920150 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4fb21aa7-cde3-4c00-b756-a9b4f5c4d8ce service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:26.023078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:26.028156 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Pushing event updated for resources: {'Port': ['ID=bbc8dfae-2d86-42bc-83ae-aa71e1207685,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:26.031924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:26.096293 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:26.244075 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:26.250188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:26.251623 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:26.262988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:26.339222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=7ccfa3dd-974b-4a20-adf7-40f06931d700,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:26.345551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:26.427986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-663c093a-e6fa-4c1c-9630-11c55aa86d6e None None] Provisioning for port bbc8dfae-2d86-42bc-83ae-aa71e1207685 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:26.440771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-663c093a-e6fa-4c1c-9630-11c55aa86d6e None None] Provisioning complete for port bbc8dfae-2d86-42bc-83ae-aa71e1207685 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:26.441203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-663c093a-e6fa-4c1c-9630-11c55aa86d6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:26.634532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-663c093a-e6fa-4c1c-9630-11c55aa86d6e None None] Port bbc8dfae-2d86-42bc-83ae-aa71e1207685 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:52:26.659001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-663c093a-e6fa-4c1c-9630-11c55aa86d6e None None] Provisioning complete for port 7ccfa3dd-974b-4a20-adf7-40f06931d700 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:26.659474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-663c093a-e6fa-4c1c-9630-11c55aa86d6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:26.710505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:26.722943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4f2c5de-2440-4810-8152-e43e71deaeb2 None None] The sync data for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi is: [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:52:26.860047 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device d790e034-e84c-4036-8b48-d5440f2583a2 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:26.963626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 4, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'bbc8dfae-2d86-42bc-83ae-aa71e1207685', 'name': '', 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'mac_address': 'fa:16:3e:f9:aa:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:24Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 1, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'subnets': [{'id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:26.969952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e16a6513-9b08-4cf4-a76a-59a54a2cabab None None] The sync data for ids ['7a936485-2ecb-4134-b5b5-6475e0f27bda'] in dv-cinder-817417-1-iscsi is: [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 4, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'bbc8dfae-2d86-42bc-83ae-aa71e1207685', 'name': '', 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'mac_address': 'fa:16:3e:f9:aa:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:24Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 1, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'subnets': [{'id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:52:27.015475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Router 7a936485-2ecb-4134-b5b5-6475e0f27bda has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:52:27.019937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port d790e034-e84c-4036-8b48-d5440f2583a2 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:27.025236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port d790e034-e84c-4036-8b48-d5440f2583a2 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:27.025658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:27.162427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-47a5c551-6663-46c8-8f3f-97a95d2f6cef None None] Provisioning complete for port d790e034-e84c-4036-8b48-d5440f2583a2 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:27.162935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-47a5c551-6663-46c8-8f3f-97a95d2f6cef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:27.227965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:27.252352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:52:27.263088 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] 10.222.0.11 "PUT /v2.0/routers/7a936485-2ecb-4134-b5b5-6475e0f27bda/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5030303 Nov 11 11:52:27.317219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port d790e034-e84c-4036-8b48-d5440f2583a2, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=d790e034-e84c-4036-8b48-d5440f2583a2,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:27.347269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:27.348200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 7ccfa3dd-974b-4a20-adf7-40f06931d700 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:27.379228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:27.431910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-47a5c551-6663-46c8-8f3f-97a95d2f6cef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:27.521687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=d790e034-e84c-4036-8b48-d5440f2583a2,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:27.529250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:27.607475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 7ccfa3dd-974b-4a20-adf7-40f06931d700 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:27.607909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:27.650217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-47a5c551-6663-46c8-8f3f-97a95d2f6cef None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:52:27.650625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-47a5c551-6663-46c8-8f3f-97a95d2f6cef None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:52:28.261758 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-47a5c551-6663-46c8-8f3f-97a95d2f6cef None None] Provisioning complete for port bbc8dfae-2d86-42bc-83ae-aa71e1207685 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:28.262303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-47a5c551-6663-46c8-8f3f-97a95d2f6cef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:28.327878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-47a5c551-6663-46c8-8f3f-97a95d2f6cef None None] Port bbc8dfae-2d86-42bc-83ae-aa71e1207685 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:52:28.874835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 00cdaa72-3172-499d-8f32-783bc7f2ee2d up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:28.979704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 00cdaa72-3172-499d-8f32-783bc7f2ee2d completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:28.986463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 00cdaa72-3172-499d-8f32-783bc7f2ee2d triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:28.987337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:29.134654 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:29.157025 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 00cdaa72-3172-499d-8f32-783bc7f2ee2d, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=00cdaa72-3172-499d-8f32-783bc7f2ee2d,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:29.185607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:29.186551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device d790e034-e84c-4036-8b48-d5440f2583a2 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:29.215778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:29.319745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=00cdaa72-3172-499d-8f32-783bc7f2ee2d,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:29.323341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:29.334790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port d790e034-e84c-4036-8b48-d5440f2583a2 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:29.335257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:30.814312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 00cdaa72-3172-499d-8f32-783bc7f2ee2d up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:30.912994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 00cdaa72-3172-499d-8f32-783bc7f2ee2d triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:30.913540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:31.366568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Sync routers for ids ['7a936485-2ecb-4134-b5b5-6475e0f27bda'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:52:31.380501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Routers {'7a936485-2ecb-4134-b5b5-6475e0f27bda'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:31.381468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['7a936485-2ecb-4134-b5b5-6475e0f27bda'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:31.599572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Set router 7a936485-2ecb-4134-b5b5-6475e0f27bda gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:32.013969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 4, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'bbc8dfae-2d86-42bc-83ae-aa71e1207685', 'name': '', 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'mac_address': 'fa:16:3e:f9:aa:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:24Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 2, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'subnets': [{'id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:32.018607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Checking router: 7a936485-2ecb-4134-b5b5-6475e0f27bda for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:52:32.019008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Updating router 7a936485-2ecb-4134-b5b5-6475e0f27bda port bbc8dfae-2d86-42bc-83ae-aa71e1207685 binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:52:32.091058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:32.323315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-8169f952-400e-4fe9-904f-6881e10328bb tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:32.325005 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-8169f952-400e-4fe9-904f-6881e10328bb tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 814 time: 0.1876156 Nov 11 11:52:32.351057 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-f2c8c8ce-33ea-4c27-a4cd-90f4e0994bc2 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/quotas/9c2955dc91344feaaa33bc192608a822 HTTP/1.1" status: 200 len: 375 time: 0.0200002 Nov 11 11:52:32.449753 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-215885c9-73b4-4260-9177-0f6abbb4490c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0972610 Nov 11 11:52:32.511650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:32.541310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Transition to ACTIVE for port object bbc8dfae-2d86-42bc-83ae-aa71e1207685 will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:32.588156 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:32.603429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-50e1dfdf-c842-4191-91df-d0fc3ee826d0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:32.606533 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-95c7a4e4-87b4-49a4-b748-da19e43d97c4 service neutron] 10.222.0.11 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1557217 Nov 11 11:52:32.750227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3033aac4-8aa5-4e78-9601-4348b1a60d2a None None] Pushing event updated for resources: {'Port': ['ID=bbc8dfae-2d86-42bc-83ae-aa71e1207685,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:32.759638 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3033aac4-8aa5-4e78-9601-4348b1a60d2a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:32.814811 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-626c222a-9c48-4ecf-a160-22d99e74a157 service neutron] 10.222.0.11 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1986609 Nov 11 11:52:32.901206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Attempting to bind port bbc8dfae-2d86-42bc-83ae-aa71e1207685 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:52:32.901618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Attempting to bind port bbc8dfae-2d86-42bc-83ae-aa71e1207685 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:52:32.902028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Attempting to bind port bbc8dfae-2d86-42bc-83ae-aa71e1207685 on network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:32.913553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:52:32.913950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Checking segment: {'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:32.914408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:32.914848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Bound using segment: {'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:52:32.915391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Bound port: bbc8dfae-2d86-42bc-83ae-aa71e1207685, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '182819e1-eced-44cf-a263-baf3680de8cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:52:32.915819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:33.063201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] For port bbc8dfae-2d86-42bc-83ae-aa71e1207685, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:52:33.067835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] For port bbc8dfae-2d86-42bc-83ae-aa71e1207685, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=bbc8dfae-2d86-42bc-83ae-aa71e1207685,segment=NetworkSegment(182819e1-eced-44cf-a263-baf3680de8cd),segment_id=182819e1-eced-44cf-a263-baf3680de8cd)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:52:33.097413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:33.122864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:33.171213 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-20b664b6-a7cc-47e4-a927-33ec4a26f38d req-d143333d-6bc5-4477-8c48-a76bf1126189 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 210 time: 0.0678267 Nov 11 11:52:33.244002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Routers {'7a936485-2ecb-4134-b5b5-6475e0f27bda'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:33.244688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['7a936485-2ecb-4134-b5b5-6475e0f27bda'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:33.326193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3033aac4-8aa5-4e78-9601-4348b1a60d2a None None] Pushing event updated for resources: {'Port': ['ID=bbc8dfae-2d86-42bc-83ae-aa71e1207685,revision_number=4']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:33.338902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3033aac4-8aa5-4e78-9601-4348b1a60d2a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:33.529189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] Set router 7a936485-2ecb-4134-b5b5-6475e0f27bda gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:33.944380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 4, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'bbc8dfae-2d86-42bc-83ae-aa71e1207685', 'name': '', 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'mac_address': 'fa:16:3e:f9:aa:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:24Z', 'updated_at': '2021-11-11T11:52:33Z', 'revision_number': 4, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'subnets': [{'id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:33.950343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fcd9ef0-0ba5-427d-9043-9dc23872beaf None None] The sync data for ids ['7a936485-2ecb-4134-b5b5-6475e0f27bda'] in dv-cinder-817417-1-iscsi is: [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:52:25Z', 'revision_number': 4, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'bbc8dfae-2d86-42bc-83ae-aa71e1207685', 'name': '', 'network_id': '3cb5b798-18d5-4595-82ee-1dd6b771d7c6', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'mac_address': 'fa:16:3e:f9:aa:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:24Z', 'updated_at': '2021-11-11T11:52:33Z', 'revision_number': 4, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'subnets': [{'id': '4b9f6aa6-3f4b-453e-be0f-e3a7a1709027', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:52:34.591991 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1f0cf64f-8021-4f5e-9001-bde9c00f4fbe req-e4e18b9d-6f2d-4da2-968d-8c129bba0388 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 210 time: 0.0805407 Nov 11 11:52:34.597922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40292) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:34.667629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:34.853249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device bbc8dfae-2d86-42bc-83ae-aa71e1207685 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:34.861866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Deleting port 40b0be19-b0ec-43d7-84d8-049462033b98 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:52:34.862610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:34.965479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port bbc8dfae-2d86-42bc-83ae-aa71e1207685 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:34.971977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port bbc8dfae-2d86-42bc-83ae-aa71e1207685 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:34.972410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:35.123595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:35.134524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:35.135056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:35.161157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port bbc8dfae-2d86-42bc-83ae-aa71e1207685, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=bbc8dfae-2d86-42bc-83ae-aa71e1207685,segment=NetworkSegment(182819e1-eced-44cf-a263-baf3680de8cd),segment_id=182819e1-eced-44cf-a263-baf3680de8cd)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:35.194045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:35.197678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:35.277543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=bbc8dfae-2d86-42bc-83ae-aa71e1207685,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:35.280038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Calling delete_port for 40b0be19-b0ec-43d7-84d8-049462033b98 owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:52:35.280970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:35.498721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-786a654a-de49-4791-a7d1-935b54b12a5c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:35.507352 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-786a654a-de49-4791-a7d1-935b54b12a5c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 814 time: 0.2993994 Nov 11 11:52:35.524486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Request body: {'port': {'device_id': '81029bd7-a808-496c-abad-87f226dd07c5', 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'admin_state_up': True, 'tenant_id': '9c2955dc91344feaaa33bc192608a822'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:35.525865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:35.541718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:35.605202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event deleted for resources: {'Port': ['ID=40b0be19-b0ec-43d7-84d8-049462033b98,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:35.609124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:35.717223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:35.754042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:35.811438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:35.816176 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-84220845-64d8-4a3c-ac3b-3a529a84ad8b req-ec6caeb4-4d44-4f97-8e8b-50f83e0f08de tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 210 time: 0.0592422 Nov 11 11:52:35.867967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Made reservation on behalf of 9c2955dc91344feaaa33bc192608a822 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:35.873671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:36.123881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Allocated IP 172.20.0.2 (b92aaf3b-0783-47c5-8158-f0c34b4d4466/52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266/80f4cc1c-ab72-48bf-8095-c5835e08bfc3) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:36.258816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Router e7a84a32-cf44-4d0e-908d-7569d000b45d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:52:36.420271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:36.487395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:36.497828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:36.500458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['52672ac7-2b99-4bcd-8a42-9c6e53617d59'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:52:36.547957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:52:36.614935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:52:36.633664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:36.667205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Pushing event updated for resources: {'Port': ['ID=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:36.675274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:36.685467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Network b92aaf3b-0783-47c5-8158-f0c34b4d4466 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:36.686966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:36.696848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:36.702542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:36.703297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:36.742577 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-33e0f8cd-6fd6-4765-a25b-97be20dca796 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "DELETE /v2.0/floatingips/5b4820f1-5f3a-4572-ab44-5eeb19c2c467 HTTP/1.1" status: 204 len: 168 time: 2.1401036 Nov 11 11:52:36.755608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:52:36.862264 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'status': 'completed', 'code': 200} Nov 11 11:52:36.878694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:36.879597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:36.915932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device bbc8dfae-2d86-42bc-83ae-aa71e1207685 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:37.110497 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5965757 Nov 11 11:52:37.126427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Request body: {'port': {'device_id': '81029bd7-a808-496c-abad-87f226dd07c5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:37.129477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:37.169637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13fd508-054b-457f-90ea-024a28ce3b85 req-3fb4b71e-8e22-4cf2-acab-3bc7b11ee84c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:37.170489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-e13fd508-054b-457f-90ea-024a28ce3b85 req-3fb4b71e-8e22-4cf2-acab-3bc7b11ee84c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Synchronizing usage tracker for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:52:37.186493 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-6183a35c-232f-4d42-9beb-7dbf96b5ff31 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 1098 time: 0.3006663 Nov 11 11:52:37.245286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-e13fd508-054b-457f-90ea-024a28ce3b85 req-3fb4b71e-8e22-4cf2-acab-3bc7b11ee84c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Unset dirty status for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:52:37.246599 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e13fd508-054b-457f-90ea-024a28ce3b85 req-3fb4b71e-8e22-4cf2-acab-3bc7b11ee84c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 931 time: 0.2466631 Nov 11 11:52:37.469634 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:37.539106 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e13fd508-054b-457f-90ea-024a28ce3b85 req-2bbee3a4-f99a-4898-85e6-4a2bc9b7b559 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2553747 Nov 11 11:52:37.595065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-da14ce00-b9ae-4753-8f47-7c5ca63bf0bc service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:37.596877 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-da14ce00-b9ae-4753-8f47-7c5ca63bf0bc service neutron] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 914 time: 0.3941996 Nov 11 11:52:37.639388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port bbc8dfae-2d86-42bc-83ae-aa71e1207685 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:37.640436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:37.792551 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-f5e01cd8-2147-4f78-a5ec-59da919eb9dc service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=07102d32-2428-42eb-8d6a-0dfe016bac85 HTTP/1.1" status: 200 len: 217 time: 0.1851397 Nov 11 11:52:37.984921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-bad4c1be-d5a9-401a-ad2e-d5da2274bb96 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:37.986511 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-bad4c1be-d5a9-401a-ad2e-d5da2274bb96 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.1845024 Nov 11 11:52:37.999467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065525fa-543f-4db1-aace-9cbbdc25b398 req-346962a9-0583-44ca-bc7f-3787282d7ee2 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:38.001086 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-065525fa-543f-4db1-aace-9cbbdc25b398 req-346962a9-0583-44ca-bc7f-3787282d7ee2 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 945 time: 0.3323243 Nov 11 11:52:38.017378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:27Z', 'revision_number': 1, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:38.022012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:52:38.034103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:38.034700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:38.250387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:38.367825 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-065525fa-543f-4db1-aace-9cbbdc25b398 req-297fdf9a-73a2-4632-8c8d-d6a4cd8f4fc6 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3056128 Nov 11 11:52:38.436666 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-badb3af9-f781-4f2d-9280-13069038434a service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.4344995 Nov 11 11:52:38.638730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:52:38.650318 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:38.689986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Transition to ACTIVE for port object 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:38.697150 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-973a3d1f-7e18-48f2-9861-2ccee4c60d86 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2475748 Nov 11 11:52:38.709265 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:27Z', 'revision_number': 1, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:38.714826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ab124c2-bf57-477c-b9ca-3879205644ae None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': 'dbf631b2-047a-4637-bc90-cce0a9808eb8', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'port_id': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'mac_address': 'fa:16:3e:6a:c0:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:47:23Z', 'updated_at': '2021-11-11T11:47:27Z', 'revision_number': 1, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:52:38.788313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:38.808704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f12775a5-7857-49f2-99ba-85a3684329e4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:39.019762 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Pushing event updated for resources: {'Port': ['ID=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:39.040833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:39.090642 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ae535174-af13-46d4-a5a1-40ba7fcc8758 req-cb420cff-a94e-482a-abcc-25d192dcc470 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3854415 Nov 11 11:52:39.128857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc526f40-617e-4217-ba47-8a5d41cfe5cf req-5b4866e8-3d7d-4900-97a1-2b437fc7b1ce tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:39.130480 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dc526f40-617e-4217-ba47-8a5d41cfe5cf req-5b4866e8-3d7d-4900-97a1-2b437fc7b1ce tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 943 time: 0.3949664 Nov 11 11:52:39.227343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4608706-ad09-4a63-a11c-8c42243f5b8d None None] New status for floating IP 5b4820f1-5f3a-4572-ab44-5eeb19c2c467: DOWN {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:52:39.253453 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dc526f40-617e-4217-ba47-8a5d41cfe5cf req-18f5b975-8789-447b-8686-e2c014c5448a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0901387 Nov 11 11:52:39.260730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Attempting to bind port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:52:39.261135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Attempting to bind port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:52:39.261514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Attempting to bind port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:39.267918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:52:39.268286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Attempting to bind port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:52:39.276366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:52:39.276754 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Checking segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:52:39.277184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Bound using segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:52:39.277674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Bound port: 80f4cc1c-ab72-48bf-8095-c5835e08bfc3, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:52:39.278068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:39.471308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] For port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:52:39.479097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] For port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:52:39.493174 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-ce7c2ea6-cc84-44e8-a082-709462f422b9 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:39.497669 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-ce7c2ea6-cc84-44e8-a082-709462f422b9 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 945 time: 0.1663647 Nov 11 11:52:39.591125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:39.603797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:39.707589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:39.709486 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] 10.222.0.60 "PUT /v2.0/ports/80f4cc1c-ab72-48bf-8095-c5835e08bfc3 HTTP/1.1" status: 200 len: 1093 time: 2.5880008 Nov 11 11:52:39.716904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Deleting port 07102d32-2428-42eb-8d6a-0dfe016bac85 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:52:39.717308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:39.742862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '81029bd7-a808-496c-abad-87f226dd07c5', 'tag': '80f4cc1c-ab72-48bf-8095-c5835e08bfc3'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:52:39.776487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Pushing event updated for resources: {'Port': ['ID=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:39.784173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:39.807817 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '81029bd7-a808-496c-abad-87f226dd07c5', 'tag': '80f4cc1c-ab72-48bf-8095-c5835e08bfc3', 'status': 'completed', 'code': 200} Nov 11 11:52:39.909365 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b42814-fb33-4c44-a636-d79d94cc5f70 req-3d4ddf69-f1ef-4527-8aee-57105163efbe tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:39.911000 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e5b42814-fb33-4c44-a636-d79d94cc5f70 req-3d4ddf69-f1ef-4527-8aee-57105163efbe tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 945 time: 0.3674080 Nov 11 11:52:40.018741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-65e811bd-e0fe-4817-a438-82698fad9f36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:40.110152 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e5b42814-fb33-4c44-a636-d79d94cc5f70 req-f896e8db-054f-4129-b022-e4b517895f6c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1898541 Nov 11 11:52:40.134952 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c5a66b44-9374-4214-a6b1-d1c550e4107d req-5d6b9079-23fb-4a62-ba6c-d7563ecde5a2 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 1096 time: 0.2960117 Nov 11 11:52:40.140359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] For port 07102d32-2428-42eb-8d6a-0dfe016bac85, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=07102d32-2428-42eb-8d6a-0dfe016bac85,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:40.140763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:40.312472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Calling delete_port for 07102d32-2428-42eb-8d6a-0dfe016bac85 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:52:40.551013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a66b44-9374-4214-a6b1-d1c550e4107d req-b69d786d-d7d1-480f-8e05-bdbfcc689582 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:40.553488 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c5a66b44-9374-4214-a6b1-d1c550e4107d req-b69d786d-d7d1-480f-8e05-bdbfcc689582 service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=9c2955dc91344feaaa33bc192608a822&shared=False HTTP/1.1" status: 200 len: 916 time: 0.4047327 Nov 11 11:52:40.735358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb80782-d047-4c6a-83a2-31933225b6d9 req-85194378-2e01-4403-b95f-8d814f58db76 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:40.737054 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ffb80782-d047-4c6a-83a2-31933225b6d9 req-85194378-2e01-4403-b95f-8d814f58db76 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 943 time: 0.3368070 Nov 11 11:52:41.096659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:41.132725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:41.264384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:41.300543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event deleted for resources: {'Port': ['ID=07102d32-2428-42eb-8d6a-0dfe016bac85,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:41.317823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:41.324955 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ffb80782-d047-4c6a-83a2-31933225b6d9 req-82ceb3d2-a77f-4e71-b06c-af26f0d2275e tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5763321 Nov 11 11:52:41.329413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a66b44-9374-4214-a6b1-d1c550e4107d req-80eb8114-21aa-4e4b-ad7b-40c66ae2c4ad service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:41.331024 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c5a66b44-9374-4214-a6b1-d1c550e4107d req-80eb8114-21aa-4e4b-ad7b-40c66ae2c4ad service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.7388959 Nov 11 11:52:41.537908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] No DVR routers for this DVR port 07102d32-2428-42eb-8d6a-0dfe016bac85 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:52:41.552827 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:41.557531 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d47c56da-dd2d-4ce4-a2a0-74e693f1568d req-d5eeab6a-79b6-4865-9c03-c5a05d1e17ab tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 210 time: 0.0863864 Nov 11 11:52:41.587055 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-25cfd1d3-876d-4218-ab3a-e1d6922c775d req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "DELETE /v2.0/ports/07102d32-2428-42eb-8d6a-0dfe016bac85 HTTP/1.1" status: 204 len: 173 time: 2.0868115 Nov 11 11:52:41.592992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2422db33-549e-474c-8a90-b9d68e460407 req-91cc34c7-f4d6-4cb9-a763-2455126f658f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:41.594542 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-91cc34c7-f4d6-4cb9-a763-2455126f658f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 815 time: 0.5510056 Nov 11 11:52:41.627738 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-caf32668-1116-4ce1-9b45-6dc8dc9c3905 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/quotas/08033101aa064f2da647814019558d4e HTTP/1.1" status: 200 len: 375 time: 0.0246322 Nov 11 11:52:41.631581 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-2c92175d-7aca-41b5-9da0-20f6615a9969 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 1096 time: 0.2474904 Nov 11 11:52:41.756259 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-131697d6-a1a3-42be-b985-af15f21f22f9 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=80f4cc1c-ab72-48bf-8095-c5835e08bfc3 HTTP/1.1" status: 200 len: 217 time: 0.0842247 Nov 11 11:52:41.810896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'name': 'network-vif-deleted', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:52:41.854268 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-9a49f760-433e-484f-b9bf-648f960fd6cb tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2197959 Nov 11 11:52:41.859813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-1b6699ab-7839-42a3-ab78-30880131f906 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:41.861554 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-1b6699ab-7839-42a3-ab78-30880131f906 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 HTTP/1.1" status: 200 len: 854 time: 0.0968738 Nov 11 11:52:41.907286 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b', 'name': 'network-vif-deleted', 'tag': '07102d32-2428-42eb-8d6a-0dfe016bac85', 'status': 'completed', 'code': 200} Nov 11 11:52:41.922770 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-d25b88e7-578e-462d-86d7-9826fbf8e6cc service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=b92aaf3b-0783-47c5-8158-f0c34b4d4466&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0507720 Nov 11 11:52:42.055960 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-514e1759-3b7b-4b77-b65e-2bb34f691023 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 11:52:42.057078 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-514e1759-3b7b-4b77-b65e-2bb34f691023 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.1906612 Nov 11 11:52:42.111929 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-884ae0dc-778c-4a08-a4d2-da0aa62ac419 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1823888 Nov 11 11:52:42.340239 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-6ea63a11-9d9d-46ce-a188-48304dfe55ba service neutron] 10.222.0.11 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2677338 Nov 11 11:52:42.349886 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5b6b9b75-eb6a-43b1-ad92-5c4a13041fb4 req-a0a4bd80-85f3-4afa-9723-dab1edbf230a service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2269638 Nov 11 11:52:42.552028 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-89cc755d-e2ba-4ed0-a1df-16fa94d77f4c service neutron] 10.222.0.11 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2046740 Nov 11 11:52:42.581052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c54b009-805d-4010-ae79-dcb005692d5a req-be318957-96a9-49d4-9e4a-a5a7ceca4f7e tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:42.582641 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0c54b009-805d-4010-ae79-dcb005692d5a req-be318957-96a9-49d4-9e4a-a5a7ceca4f7e tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 943 time: 0.1116722 Nov 11 11:52:42.632976 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0c54b009-805d-4010-ae79-dcb005692d5a req-355d5887-4d7f-4f6a-bd79-309a1dd6cdca tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439842 Nov 11 11:52:42.833744 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4149cf9b-1c0e-4fc2-b17b-b41a31efbf67 req-cc792129-df7c-441c-8e86-34796511d2ac tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 210 time: 0.0925140 Nov 11 11:52:42.835094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7e72c0bd-d818-4527-9cf5-ef87a75f8a40 req-28b41d05-44af-40f1-902f-1a7b793fbac0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Synchronizing usage tracker for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:52:42.882088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7e72c0bd-d818-4527-9cf5-ef87a75f8a40 req-28b41d05-44af-40f1-902f-1a7b793fbac0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Unset dirty status for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:52:42.883598 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7e72c0bd-d818-4527-9cf5-ef87a75f8a40 req-28b41d05-44af-40f1-902f-1a7b793fbac0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=ac1870b0-3b8a-4bda-b8a5-40cae5fcf12b HTTP/1.1" status: 200 len: 210 time: 0.1074579 Nov 11 11:52:43.487637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6e7d6038-583d-4439-9a1a-a9e276577156 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:43.550830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:43.849834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e29f522-293c-4f70-8146-456c3d636da3 req-a9511fb1-a64b-46c0-9672-5a4f139c70cf tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:43.851441 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e29f522-293c-4f70-8146-456c3d636da3 req-a9511fb1-a64b-46c0-9672-5a4f139c70cf tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 943 time: 0.0884070 Nov 11 11:52:43.901996 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e29f522-293c-4f70-8146-456c3d636da3 req-81db0fc4-11f8-49fe-bb03-de7aa579261d tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439513 Nov 11 11:52:44.020152 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-034a2f5e-86a1-45c9-bcfc-e7028a7d7bec req-4bde0943-157b-4dfb-accf-9fe46db5f353 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 210 time: 0.0486023 Nov 11 11:52:44.483070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 07102d32-2428-42eb-8d6a-0dfe016bac85 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:52:44.516688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 07102d32-2428-42eb-8d6a-0dfe016bac85 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:52:44.517096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 07102d32-2428-42eb-8d6a-0dfe016bac85 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:52:44.688906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:44.838050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2422db33-549e-474c-8a90-b9d68e460407 req-c17bbcc9-e889-4e2b-98a2-d4203dea0c95 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:44.839584 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-c17bbcc9-e889-4e2b-98a2-d4203dea0c95 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.60 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 815 time: 0.1636455 Nov 11 11:52:44.858457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'port': {'device_id': 'da29b497-f07f-4562-b681-42e65d990cba', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'admin_state_up': True, 'tenant_id': '08033101aa064f2da647814019558d4e'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:52:45.009280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:52:45.013442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:port and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:52:45.016494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:52:45.023258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:52:45.073377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Made reservation on behalf of 08033101aa064f2da647814019558d4e for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:52:45.078841 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:45.448553 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-19722cf0-b9d8-43bd-98cf-48edec2221b3 req-c876d315-5d4c-46e5-945d-372598b65df5 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 210 time: 0.2989323 Nov 11 11:52:45.493527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a78c50-dc2b-42d5-acb5-b6e0de3f1d49 req-a6667352-6d95-425a-9b56-e843e3883f8a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:45.495121 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45a78c50-dc2b-42d5-acb5-b6e0de3f1d49 req-a6667352-6d95-425a-9b56-e843e3883f8a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 943 time: 0.4621816 Nov 11 11:52:45.597246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Allocated IP 172.20.0.10 (16848b15-b078-4b3f-a9fe-4cd0b9fefdf4/74c32ff7-aa8c-4ebd-bce0-516dac9bf326/370e3435-46b3-4afc-bb1d-6461d4bd991b) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:52:45.604060 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45a78c50-dc2b-42d5-acb5-b6e0de3f1d49 req-7be24fb6-46fb-4815-9a40-caee07350c79 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782530 Nov 11 11:52:45.848145 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:45.872126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Transition to ACTIVE for port object 370e3435-46b3-4afc-bb1d-6461d4bd991b will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:52:45.940846 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:45.947649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-57f641ca-ee45-4723-a4bd-32574c3d7eb5 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:46.012137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:52:46.015519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:52:46.025041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:52:46.071255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'Port': ['ID=370e3435-46b3-4afc-bb1d-6461d4bd991b,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:46.081205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:46.110629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:46.111432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:46.296174 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4414423 Nov 11 11:52:46.426087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6a6b9141-628f-455a-bf24-3ee346489b59 None None] Provisioning for port 370e3435-46b3-4afc-bb1d-6461d4bd991b completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:46.432122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-6a6b9141-628f-455a-bf24-3ee346489b59 None None] Provisioning complete for port 370e3435-46b3-4afc-bb1d-6461d4bd991b triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:46.432554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6a6b9141-628f-455a-bf24-3ee346489b59 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:46.489583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-6a6b9141-628f-455a-bf24-3ee346489b59 None None] Port 370e3435-46b3-4afc-bb1d-6461d4bd991b cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:52:46.502926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:52:46.678834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:46.698808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '80f4cc1c-ab72-48bf-8095-c5835e08bfc3', 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'port_id': '80f4cc1c-ab72-48bf-8095-c5835e08bfc3', 'mac_address': 'fa:16:3e:22:2d:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1024, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:52:46.728396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1429da53-0b73-47cc-afa8-5be11de5e551 req-f9654c97-73d6-4fbe-95e6-82abec221df2 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:46.729485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-1429da53-0b73-47cc-afa8-5be11de5e551 req-f9654c97-73d6-4fbe-95e6-82abec221df2 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Synchronizing usage tracker for tenant:08033101aa064f2da647814019558d4e on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:52:46.738751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40408) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:52:46.783105 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:46.812487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:52:46.841638 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:46.843668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-1429da53-0b73-47cc-afa8-5be11de5e551 req-f9654c97-73d6-4fbe-95e6-82abec221df2 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Unset dirty status for tenant:08033101aa064f2da647814019558d4e on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:52:46.845239 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1429da53-0b73-47cc-afa8-5be11de5e551 req-f9654c97-73d6-4fbe-95e6-82abec221df2 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.2500422 Nov 11 11:52:46.871826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:46.875060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:46.956620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:46.960956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:46.976938 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1429da53-0b73-47cc-afa8-5be11de5e551 req-34f1eb76-e739-4124-b3cc-3c496395a428 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211507 Nov 11 11:52:46.986903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c0852b-c361-433b-8b45-e5172da54fe8 req-fb9fb5e3-fe44-42e6-8522-df496f51e685 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:46.990144 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-81c0852b-c361-433b-8b45-e5172da54fe8 req-fb9fb5e3-fe44-42e6-8522-df496f51e685 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 943 time: 0.1956391 Nov 11 11:52:46.999777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Deleting port 4789aee2-2728-4e8b-b0f1-5aa103146372 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:52:47.000596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:47.061618 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-81c0852b-c361-433b-8b45-e5172da54fe8 req-33ec2f74-fe59-47d9-a0e5-324b49272eea tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633659 Nov 11 11:52:47.199128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:47.199527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:47.244264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['80f4cc1c-ab72-48bf-8095-c5835e08bfc3'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:52:47.338675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Calling delete_port for 4789aee2-2728-4e8b-b0f1-5aa103146372 owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:52:47.586318 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:47.592369 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:47.638131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event deleted for resources: {'Port': ['ID=4789aee2-2728-4e8b-b0f1-5aa103146372,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:47.651598 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.652031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.652837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.652837 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.653316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.653640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.655238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.655684 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.656115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.656537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.656954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:52:47.685805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:47.758430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:48.322499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a47bc0-8936-4d93-b27f-dc9cad08e1cd req-bfade071-75c8-47ad-b306-74d65167079b tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:48.324107 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c1a47bc0-8936-4d93-b27f-dc9cad08e1cd req-bfade071-75c8-47ad-b306-74d65167079b tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1992509 Nov 11 11:52:48.385110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e4374b9-59af-4ad0-954f-4e36a5d0e68e req-98a13603-4dd8-4ea0-bc82-16dbb634d18a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:48.386740 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e4374b9-59af-4ad0-954f-4e36a5d0e68e req-98a13603-4dd8-4ea0-bc82-16dbb634d18a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 944 time: 0.1519632 Nov 11 11:52:48.420210 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c1a47bc0-8936-4d93-b27f-dc9cad08e1cd req-bc235dbf-c0bc-4947-aa51-39137cd2e190 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875082 Nov 11 11:52:48.447589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Router e7a84a32-cf44-4d0e-908d-7569d000b45d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:52:48.456501 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e4374b9-59af-4ad0-954f-4e36a5d0e68e req-56e2fb99-ef57-4231-b3dc-1a5522d03555 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597708 Nov 11 11:52:48.527589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:52:48.650224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:52:48.656597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:52:48.657028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:48.704324 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:52:48.722959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:52:48.769944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:48.782688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:48.783435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:48.828884 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "DELETE /v2.0/floatingips/dbf631b2-047a-4637-bc90-cce0a9808eb8 HTTP/1.1" status: 204 len: 168 time: 2.0889344 Nov 11 11:52:48.829930 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:52:48.915236 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'status': 'completed', 'code': 200} Nov 11 11:52:49.109053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:49.175880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:52:49.176944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '81029bd7-a808-496c-abad-87f226dd07c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80f4cc1c-ab72-48bf-8095-c5835e08bfc3'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:52:49.204696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:52:49.207410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:52:49.254687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:49.360939 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:52:49.364558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:52:49.435102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5670be8c-e0e8-4bd4-8952-a705719d79c8 req-e89469c2-0dd6-49a3-a29b-afd3b7e14198 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:49.441051 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5670be8c-e0e8-4bd4-8952-a705719d79c8 req-e89469c2-0dd6-49a3-a29b-afd3b7e14198 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.1266444 Nov 11 11:52:49.495770 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '81029bd7-a808-496c-abad-87f226dd07c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80f4cc1c-ab72-48bf-8095-c5835e08bfc3', 'code': 200} Nov 11 11:52:49.533168 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5670be8c-e0e8-4bd4-8952-a705719d79c8 req-6b315417-4aea-454f-ad37-946cf3250978 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0854399 Nov 11 11:52:49.753472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:49.758645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:52:49.770844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:52:49.771565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:52:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:49.826292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c0246a-7fa5-475a-bfc9-72cf044f6e0f req-58b676d3-d858-4d59-9b34-f58812947543 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:49.828369 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e6c0246a-7fa5-475a-bfc9-72cf044f6e0f req-58b676d3-d858-4d59-9b34-f58812947543 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1665571 Nov 11 11:52:49.852220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf1858f-6942-401e-a26b-4e87dce2513b req-519c96d1-7ae1-4ced-a579-875145d35311 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:49.855633 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1bf1858f-6942-401e-a26b-4e87dce2513b req-519c96d1-7ae1-4ced-a579-875145d35311 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1394005 Nov 11 11:52:49.940134 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1bf1858f-6942-401e-a26b-4e87dce2513b req-5c483f5c-ba89-426b-a151-46397f27e1e3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621712 Nov 11 11:52:49.948504 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e6c0246a-7fa5-475a-bfc9-72cf044f6e0f req-76289ef5-0842-4364-94b7-93bcf07895a8 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909421 Nov 11 11:52:50.006076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:52:50.346519 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:52:50.350839 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06887f83-2c7e-4104-86e8-74d1614d3c72 None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:42:54Z', 'revision_number': 4, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': '591fa385-fa3e-401b-9805-c6a8d6414fa3', 'name': '', 'network_id': 'd5ec5e34-ac26-4927-b077-b0742eacb0fd', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'mac_address': 'fa:16:3e:ee:18:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:53Z', 'updated_at': '2021-11-11T11:43:05Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'subnets': [{'id': '6e9509c6-37ce-4e40-8036-e5d45e65095d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:52:50.765755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edae4f74-ca35-49c3-a85a-9b29bdaca313 req-6393de0a-d13d-4e10-859c-fd5c4bb4550c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:50.768295 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-edae4f74-ca35-49c3-a85a-9b29bdaca313 req-6393de0a-d13d-4e10-859c-fd5c4bb4550c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.1011338 Nov 11 11:52:50.822031 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-edae4f74-ca35-49c3-a85a-9b29bdaca313 req-67ce4b3f-cf33-436a-8bbc-957e7ff0e1cd tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465806 Nov 11 11:52:50.861763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0c1ac93-1c16-4980-a91f-8b5189edf8b5 None None] New status for floating IP dbf631b2-047a-4637-bc90-cce0a9808eb8: DOWN {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:52:51.258164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020c261e-f11f-4cd8-98e3-dcaf949cf55c req-62e151db-b363-401c-b44c-3dd634981262 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:51.263555 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-020c261e-f11f-4cd8-98e3-dcaf949cf55c req-62e151db-b363-401c-b44c-3dd634981262 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1651571 Nov 11 11:52:51.271394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4781aff4-207f-412f-b36c-e5d5ec02eafd req-c6221810-d0d0-441c-9edd-72a4ee601ce7 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:51.273104 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4781aff4-207f-412f-b36c-e5d5ec02eafd req-c6221810-d0d0-441c-9edd-72a4ee601ce7 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1300607 Nov 11 11:52:51.357991 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-020c261e-f11f-4cd8-98e3-dcaf949cf55c req-aafb3201-6c11-4623-afac-8cd0c87ee37c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832481 Nov 11 11:52:51.365740 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4781aff4-207f-412f-b36c-e5d5ec02eafd req-274d9121-fd41-4005-a995-ef11a25b74c4 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735497 Nov 11 11:52:52.065935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5257d8-5424-427c-b40d-96a2d8f73403 req-8cdb0e16-fb8e-462d-9550-0822cc3134bf tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:52.067644 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ef5257d8-5424-427c-b40d-96a2d8f73403 req-8cdb0e16-fb8e-462d-9550-0822cc3134bf tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.1020722 Nov 11 11:52:52.120907 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ef5257d8-5424-427c-b40d-96a2d8f73403 req-fb92a738-868b-41af-bc35-0f6f7ced18a5 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467522 Nov 11 11:52:52.678799 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a577fb4-aacd-4df8-a963-75c0eac949b8 req-f8abf65a-03f6-4676-91e2-159b485f46eb tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:52.680972 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5a577fb4-aacd-4df8-a963-75c0eac949b8 req-f8abf65a-03f6-4676-91e2-159b485f46eb tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1718123 Nov 11 11:52:52.686862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44840948-10c5-42ff-9cdd-4a4e336b7c27 req-f460137e-6b72-43ee-87ed-a1d9fa5f6e74 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:52.688387 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-44840948-10c5-42ff-9cdd-4a4e336b7c27 req-f460137e-6b72-43ee-87ed-a1d9fa5f6e74 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1242254 Nov 11 11:52:52.774864 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5a577fb4-aacd-4df8-a963-75c0eac949b8 req-bd52a522-25da-42e0-b95d-ff8aaff7b493 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848951 Nov 11 11:52:52.777501 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-44840948-10c5-42ff-9cdd-4a4e336b7c27 req-aa8eea1c-b317-47f3-b699-3208fee2dec3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724854 Nov 11 11:52:53.339833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-092694d9-235e-437f-be2f-c9dfff4a4d9b req-f2a74826-bb25-4700-8033-866940b55fb4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:53.344028 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-092694d9-235e-437f-be2f-c9dfff4a4d9b req-f2a74826-bb25-4700-8033-866940b55fb4 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.0857182 Nov 11 11:52:53.395943 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-092694d9-235e-437f-be2f-c9dfff4a4d9b req-5cd14be3-e330-4b21-9c44-d3bcb7fa6bbf tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477729 Nov 11 11:52:54.062850 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8794a3-6c59-4e0b-8dd9-dc1bf2e33d1a req-16d88271-27e1-4084-941f-f38e7e1b5aa9 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:54.064857 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2c8794a3-6c59-4e0b-8dd9-dc1bf2e33d1a req-16d88271-27e1-4084-941f-f38e7e1b5aa9 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1594493 Nov 11 11:52:54.072201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3892cb03-3f5c-425a-a258-27d87fc499ed req-04177529-1404-483d-a717-c185bd371143 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:54.073712 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3892cb03-3f5c-425a-a258-27d87fc499ed req-04177529-1404-483d-a717-c185bd371143 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1343949 Nov 11 11:52:54.167766 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2c8794a3-6c59-4e0b-8dd9-dc1bf2e33d1a req-9595150b-266e-478f-9b12-4042747a9a41 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0929918 Nov 11 11:52:54.170332 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3892cb03-3f5c-425a-a258-27d87fc499ed req-485abd53-cb77-47f6-97f3-2b92f0fb400f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0792782 Nov 11 11:52:54.660511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d60c0880-afb7-492e-af6e-f62e7181cf24 req-0e0777bc-332f-4288-a164-3b4f59c05b4d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:54.663123 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d60c0880-afb7-492e-af6e-f62e7181cf24 req-0e0777bc-332f-4288-a164-3b4f59c05b4d tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.1161492 Nov 11 11:52:54.725008 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d60c0880-afb7-492e-af6e-f62e7181cf24 req-219bb6d9-8bd1-444b-b923-0d4bb38d33de tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0540872 Nov 11 11:52:55.471584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db5204a5-e039-4c7b-b177-49cbf9924399 req-acea1680-6634-42b4-ae4f-f693a17f4bbb tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:55.473317 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db5204a5-e039-4c7b-b177-49cbf9924399 req-acea1680-6634-42b4-ae4f-f693a17f4bbb tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1590431 Nov 11 11:52:55.480813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b295b3-f166-46a6-90ce-372f4e2af98c req-3b0fe8dc-d7cf-4463-b5df-af545f3cb1f6 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:55.482679 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c8b295b3-f166-46a6-90ce-372f4e2af98c req-3b0fe8dc-d7cf-4463-b5df-af545f3cb1f6 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1669912 Nov 11 11:52:55.603751 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db5204a5-e039-4c7b-b177-49cbf9924399 req-32a94517-d057-4546-a184-566e94999ec1 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1190686 Nov 11 11:52:55.624571 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c8b295b3-f166-46a6-90ce-372f4e2af98c req-d0d7692b-63e3-4155-8014-8ee1e30d1b77 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1240191 Nov 11 11:52:55.966459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63894188-0d2b-4f18-9dd7-fa76362cb388 req-43d8e724-f381-4a54-8930-ec3f9017375c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:55.968509 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-63894188-0d2b-4f18-9dd7-fa76362cb388 req-43d8e724-f381-4a54-8930-ec3f9017375c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.1036420 Nov 11 11:52:56.024555 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-63894188-0d2b-4f18-9dd7-fa76362cb388 req-a5441ea8-5d91-4ee1-b4d9-647afcbbe789 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493417 Nov 11 11:52:56.915285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de0ffb59-eae7-48c0-9b7f-3ed2a9152f18 req-5fe87edb-8cba-42c9-a8de-147b14aa9692 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:56.916835 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-de0ffb59-eae7-48c0-9b7f-3ed2a9152f18 req-5fe87edb-8cba-42c9-a8de-147b14aa9692 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1690104 Nov 11 11:52:56.926859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3ac64e-008c-4a0d-91d8-a495119e380e req-d65daacc-d289-48d1-89a4-08956bcc4162 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:56.928389 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e3ac64e-008c-4a0d-91d8-a495119e380e req-d65daacc-d289-48d1-89a4-08956bcc4162 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1284559 Nov 11 11:52:57.010202 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-de0ffb59-eae7-48c0-9b7f-3ed2a9152f18 req-e97db0af-2e3b-4e64-8b5a-3b5b1db9685d tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0807717 Nov 11 11:52:57.017843 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6e3ac64e-008c-4a0d-91d8-a495119e380e req-3e886555-30ca-4bf1-a3c3-55479f21d536 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705330 Nov 11 11:52:57.254806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00ffd31-5b11-442d-aecc-6304f1e400fb req-d9fc159c-70d2-46c5-8ae0-319a542d4324 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:57.256536 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e00ffd31-5b11-442d-aecc-6304f1e400fb req-d9fc159c-70d2-46c5-8ae0-319a542d4324 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.0917857 Nov 11 11:52:57.307623 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e00ffd31-5b11-442d-aecc-6304f1e400fb req-6d344b36-1c92-4a97-a214-c8a954456c28 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446985 Nov 11 11:52:58.290112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc40fd3-7841-40ba-b75e-b69c3671e5b8 req-6b16c2bd-8703-4c68-9232-9db5ad689e41 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:58.292273 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9bc40fd3-7841-40ba-b75e-b69c3671e5b8 req-6b16c2bd-8703-4c68-9232-9db5ad689e41 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1490412 Nov 11 11:52:58.298403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-758af992-b7e7-455b-8d84-d273996adc08 req-80e5ee43-d880-4581-ac30-018a3185f34b tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:58.300034 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-758af992-b7e7-455b-8d84-d273996adc08 req-80e5ee43-d880-4581-ac30-018a3185f34b tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1593132 Nov 11 11:52:58.377915 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9bc40fd3-7841-40ba-b75e-b69c3671e5b8 req-6b20cf29-534b-41a6-8c5a-53d2e3b35a04 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767298 Nov 11 11:52:58.380121 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-758af992-b7e7-455b-8d84-d273996adc08 req-1e0d8f10-f1b3-4ad0-8e14-a2560ea3af04 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647008 Nov 11 11:52:58.584149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10218907-f3f5-487e-b8c7-43081ae91d18 req-5e31c9ba-956b-4a04-bf97-dff180ef676c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:58.585792 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-10218907-f3f5-487e-b8c7-43081ae91d18 req-5e31c9ba-956b-4a04-bf97-dff180ef676c tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.0914922 Nov 11 11:52:58.849256 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-10218907-f3f5-487e-b8c7-43081ae91d18 req-b61392a9-60a2-4987-b84e-952b6b6be940 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2569389 Nov 11 11:52:59.651122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dfcae80-e1b1-4ea8-b24c-24be304fbd6a req-9774f5fd-d846-4e93-9f95-f7d836f1e4a4 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:59.652739 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7dfcae80-e1b1-4ea8-b24c-24be304fbd6a req-9774f5fd-d846-4e93-9f95-f7d836f1e4a4 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.1488469 Nov 11 11:52:59.659496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5d1189-8659-43c5-a5a0-0276fc88e569 req-accc6b97-6a78-4b24-afb8-72bc8605b251 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:52:59.660980 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8a5d1189-8659-43c5-a5a0-0276fc88e569 req-accc6b97-6a78-4b24-afb8-72bc8605b251 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1227622 Nov 11 11:52:59.746101 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7dfcae80-e1b1-4ea8-b24c-24be304fbd6a req-56c134d3-3aad-40b5-9ca2-67990570d7ed tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838282 Nov 11 11:52:59.748860 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8a5d1189-8659-43c5-a5a0-0276fc88e569 req-ac5b8d79-31f6-401c-afb3-7eb48c6a3f90 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708690 Nov 11 11:53:00.056628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16fded50-790f-418e-a1c0-de75150fd118 req-1b799a1a-9345-49b9-a8a5-96d17b06aef1 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:00.058801 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-16fded50-790f-418e-a1c0-de75150fd118 req-1b799a1a-9345-49b9-a8a5-96d17b06aef1 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.0862625 Nov 11 11:53:00.113570 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-16fded50-790f-418e-a1c0-de75150fd118 req-85912d7a-ef65-4717-bb46-04d677bde5ce tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486057 Nov 11 11:53:00.611418 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:53:00.795717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Request body: {'port': {'device_id': 'da29b497-f07f-4562-b681-42e65d990cba', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:01.116899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:01.124354 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67567d0a-1e12-4496-91de-bfeb8e3864da req-a38cceb2-1d48-4525-aa92-3f6e9f2b661c service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 1098 time: 0.0896513 Nov 11 11:53:01.146802 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-36cab73a-6dde-4a4a-8d15-bf907c156d9e service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 1098 time: 0.3175745 Nov 11 11:53:01.175809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-67567d0a-1e12-4496-91de-bfeb8e3864da req-5ff85fc7-08c4-48f8-bdfc-8c48000f8c3a service neutron] Synchronizing usage tracker for tenant:dedb9d8cb3fd4377bd70dd2e2a35755f on resource:security_group {{(pid=88328) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:53:01.213693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-67567d0a-1e12-4496-91de-bfeb8e3864da req-5ff85fc7-08c4-48f8-bdfc-8c48000f8c3a service neutron] Unset dirty status for tenant:dedb9d8cb3fd4377bd70dd2e2a35755f on resource:security_group {{(pid=88328) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:53:01.215067 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67567d0a-1e12-4496-91de-bfeb8e3864da req-5ff85fc7-08c4-48f8-bdfc-8c48000f8c3a service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794611 Nov 11 11:53:01.234982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee338e03-739f-4f30-892d-d21bc9d8805f req-52ae2721-8adf-4af7-a56e-e7695172c5e2 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:01.236652 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ee338e03-739f-4f30-892d-d21bc9d8805f req-52ae2721-8adf-4af7-a56e-e7695172c5e2 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.3546979 Nov 11 11:53:01.266571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d483b576-721b-4ce1-aaf0-9a0db103db73 req-7dcf9908-096e-476d-8e18-f6fe6c049bbf tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:01.268275 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d483b576-721b-4ce1-aaf0-9a0db103db73 req-7dcf9908-096e-476d-8e18-f6fe6c049bbf tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 932 time: 0.3308218 Nov 11 11:53:01.508764 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ee338e03-739f-4f30-892d-d21bc9d8805f req-f85f315a-4efb-4b11-a9db-5cd1d4ea7e98 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2513862 Nov 11 11:53:01.540361 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d483b576-721b-4ce1-aaf0-9a0db103db73 req-ab206955-f3c5-43f4-9a38-3305a872deb1 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2516460 Nov 11 11:53:01.584051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-66eeb679-cc25-493b-99aa-0066a49dea42 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:01.585744 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-66eeb679-cc25-493b-99aa-0066a49dea42 service neutron] 10.222.0.60 "GET /v2.0/networks?id=d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 200 len: 914 time: 0.4261065 Nov 11 11:53:01.770339 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-1656ee65-fe5a-43ff-8df2-e9149ca309bd service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde HTTP/1.1" status: 200 len: 217 time: 0.1703963 Nov 11 11:53:01.902887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7409b8d8-0097-4086-9846-ee3d29da7acf req-4d357e90-70b7-448e-a7fe-2944761aaa20 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:01.911402 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7409b8d8-0097-4086-9846-ee3d29da7acf req-4d357e90-70b7-448e-a7fe-2944761aaa20 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.1969128 Nov 11 11:53:02.005800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-77d6c3f4-4bb6-4ce4-a21b-e99bad734431 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:02.007456 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-77d6c3f4-4bb6-4ce4-a21b-e99bad734431 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 200 len: 851 time: 0.1753330 Nov 11 11:53:02.017221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 370e3435-46b3-4afc-bb1d-6461d4bd991b {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:53:02.080057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:02.098140 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7409b8d8-0097-4086-9846-ee3d29da7acf req-897ee9ab-3da9-44b2-a564-8b6211f3f43a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/security-groups?id=82ca2c36-3087-406f-9689-58bdf145dcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1788177 Nov 11 11:53:02.113505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Transition to ACTIVE for port object 370e3435-46b3-4afc-bb1d-6461d4bd991b will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:53:02.123322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-5411c3c1-0d9c-4194-8aff-4735d65446f7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:02.124172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-5411c3c1-0d9c-4194-8aff-4735d65446f7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Synchronizing usage tracker for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88328) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:53:02.149082 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-cf12bf1e-5ae7-42a1-9197-5aff85027539 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=d5ec5e34-ac26-4927-b077-b0742eacb0fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1258540 Nov 11 11:53:02.282891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-5411c3c1-0d9c-4194-8aff-4735d65446f7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Unset dirty status for tenant:1bcfb2b970f34aa9af017e16d6e4c699 on resource:port {{(pid=88328) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:53:02.284315 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-5411c3c1-0d9c-4194-8aff-4735d65446f7 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 945 time: 0.2513993 Nov 11 11:53:02.292730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:02.299726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:02.338450 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-a98e1cfa-3656-4bd7-ac9e-a1f13ae09954 service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1822476 Nov 11 11:53:02.373354 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Deleting port 7d814c54-0cf1-43cc-a16a-8adadf324bde {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:02.373746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:02.559044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Pushing event updated for resources: {'Port': ['ID=370e3435-46b3-4afc-bb1d-6461d4bd991b,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:02.570834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:02.692888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] For port 7d814c54-0cf1-43cc-a16a-8adadf324bde, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=7d814c54-0cf1-43cc-a16a-8adadf324bde,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:02.693571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:02.716226 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-6034f143-9148-4a38-91cd-6566af411fed service neutron] 10.222.0.60 "GET /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3652406 Nov 11 11:53:02.863352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Calling delete_port for 7d814c54-0cf1-43cc-a16a-8adadf324bde owned by compute:nova {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:03.066372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Attempting to bind port 370e3435-46b3-4afc-bb1d-6461d4bd991b on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:53:03.066985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Attempting to bind port 370e3435-46b3-4afc-bb1d-6461d4bd991b by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:53:03.067125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Attempting to bind port 370e3435-46b3-4afc-bb1d-6461d4bd991b on network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:53:03.096198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Port 370e3435-46b3-4afc-bb1d-6461d4bd991b on network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:53:03.096198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Attempting to bind port 370e3435-46b3-4afc-bb1d-6461d4bd991b on network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:53:03.115677 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 52, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:53:03.115979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Checking segment: {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:53:03.116427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Bound using segment: {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:53:03.116874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Bound port: 370e3435-46b3-4afc-bb1d-6461d4bd991b, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '79ee61d3-8883-4921-b5ea-a86abe95cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1043, 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:53:03.117257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:03.135486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:03.143565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cde2e1e6-27ba-426b-8ade-0accceeb985f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:03.187550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event deleted for resources: {'Port': ['ID=7d814c54-0cf1-43cc-a16a-8adadf324bde,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:03.190637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:03.213958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778e09d9-c80b-4318-9e92-35adbc8394af req-e73f8bbe-cc4e-483c-a2f6-50e8dd4507de tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:03.215629 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-778e09d9-c80b-4318-9e92-35adbc8394af req-e73f8bbe-cc4e-483c-a2f6-50e8dd4507de tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.4534335 Nov 11 11:53:03.224484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21b858a-7035-4672-9fe7-f41bc5180257 req-2a18168b-5057-4ab8-97c0-0b6a1598ee6a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:03.226025 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c21b858a-7035-4672-9fe7-f41bc5180257 req-2a18168b-5057-4ab8-97c0-0b6a1598ee6a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 944 time: 0.4533203 Nov 11 11:53:03.298921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] No DVR routers for this DVR port 7d814c54-0cf1-43cc-a16a-8adadf324bde on host hv-cinder-81741 {{(pid=88328) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:53:03.298921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:03.298921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'name': 'network-vif-deleted', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:03.317606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] For port 370e3435-46b3-4afc-bb1d-6461d4bd991b, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:53:03.323871 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e6154e21-6621-4c3d-b38f-6c7fe34a5876 req-f355a1da-6cde-48d5-886f-1659af56af32 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.60 "DELETE /v2.0/ports/7d814c54-0cf1-43cc-a16a-8adadf324bde HTTP/1.1" status: 204 len: 173 time: 1.0337870 Nov 11 11:53:03.340720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] For port 370e3435-46b3-4afc-bb1d-6461d4bd991b, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:53:03.347323 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-778e09d9-c80b-4318-9e92-35adbc8394af req-d0f5bd9a-404a-4108-acfe-1992ac5d1ca2 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1120012 Nov 11 11:53:03.347516 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c21b858a-7035-4672-9fe7-f41bc5180257 req-838befbf-5dd5-42b5-aca9-8df940aebe44 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1128597 Nov 11 11:53:03.398189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:03.403740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b2183a4b-596a-434a-9a53-a00da4374661 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:03.525005 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dd05b4cf-319a-4d9a-9741-a595c032f800', 'name': 'network-vif-deleted', 'tag': '7d814c54-0cf1-43cc-a16a-8adadf324bde', 'status': 'completed', 'code': 200} Nov 11 11:53:03.540620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:03.542273 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] 10.222.0.60 "PUT /v2.0/ports/370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 1094 time: 2.7548299 Nov 11 11:53:03.543417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:03.553545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Pushing event updated for resources: {'Port': ['ID=370e3435-46b3-4afc-bb1d-6461d4bd991b,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:03.559524 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0967d8f2-6bf1-4d98-a4e2-69ba3ccb0de7 req-5a5bf343-7cd3-44e0-bce2-caa2e3746065 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "GET /v2.0/ports?device_id=dd05b4cf-319a-4d9a-9741-a595c032f800 HTTP/1.1" status: 200 len: 210 time: 0.0880206 Nov 11 11:53:03.567627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.568148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.568628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.569087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.569554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.570019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.570498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.570958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.571602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.572191 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.572660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:03.577428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:03.653554 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'status': 'completed', 'code': 200} Nov 11 11:53:03.700603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-a8969020-a3d1-49d8-b545-509273e67f37 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1097 time: 0.0894914 Nov 11 11:53:03.776171 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-d788f1b9-d2f7-438b-851c-d204cd80610d service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 217 time: 0.0675781 Nov 11 11:53:03.856770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2422db33-549e-474c-8a90-b9d68e460407 req-7a58186c-3993-41a1-863a-278fc1033df8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:03.858327 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-7a58186c-3993-41a1-863a-278fc1033df8 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 200 len: 854 time: 0.0739384 Nov 11 11:53:03.939334 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-1ce2db1e-53c9-4fd4-95b7-bedcdd0a400c service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0748053 Nov 11 11:53:04.087268 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-0a6de6c0-865e-46fb-bee2-aa6cffbd96d6 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1411810 Nov 11 11:53:04.232029 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2422db33-549e-474c-8a90-b9d68e460407 req-5bc27eac-81f1-4399-83cb-97c0420b84ce service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1382043 Nov 11 11:53:04.447747 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-4aa77017-164e-49ae-9e81-01f17d7dfd64 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1097 time: 0.0934236 Nov 11 11:53:04.712289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:04.747993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-583e2ace-d7c9-42ab-94f0-2231a623b0f3 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:04.749574 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-583e2ace-d7c9-42ab-94f0-2231a623b0f3 service neutron] 10.222.0.60 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 917 time: 0.2947426 Nov 11 11:53:04.831950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6ee740-0c42-4158-9b34-e0ed1bc510ea req-a967cbf8-b45d-4161-9be5-92b640e3debf tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:04.833462 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-de6ee740-0c42-4158-9b34-e0ed1bc510ea req-a967cbf8-b45d-4161-9be5-92b640e3debf tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.3456464 Nov 11 11:53:04.849573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b752e4-0d69-4de5-b3bb-7104c51cede7 req-420b31c2-2f76-4696-8673-c8282338b3a5 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:04.851185 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67b752e4-0d69-4de5-b3bb-7104c51cede7 req-420b31c2-2f76-4696-8673-c8282338b3a5 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 944 time: 0.3525271 Nov 11 11:53:04.867137 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-b2e8533f-e850-4603-a2f6-29ef6c5fa414 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 217 time: 0.1097550 Nov 11 11:53:04.991668 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-de6ee740-0c42-4158-9b34-e0ed1bc510ea req-6c65e74f-5b7c-4808-8dfc-d0276d501175 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1484227 Nov 11 11:53:04.999457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-6bc0004b-a2d3-44f8-8b98-28048f8324f2 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:05.001065 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-6bc0004b-a2d3-44f8-8b98-28048f8324f2 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 200 len: 854 time: 0.1134701 Nov 11 11:53:05.003539 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67b752e4-0d69-4de5-b3bb-7104c51cede7 req-a0da4508-731a-4581-9968-1908e4179072 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1337137 Nov 11 11:53:05.094464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40506) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:05.170372 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-5f5cdf98-6c02-4e88-90f9-691bbeec2a08 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1615276 Nov 11 11:53:05.368692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Deleting port 7330e3ff-bb68-439e-a213-3f2b9a383c0e {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:05.369045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:05.507468 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-05dbaa12-7238-4bc5-9188-9c09f8a397db service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3242614 Nov 11 11:53:05.710202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:05.710593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:05.855932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Calling delete_port for 7330e3ff-bb68-439e-a213-3f2b9a383c0e owned by network:floatingip {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:05.901339 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-080d94fd-15f1-4194-bb2b-8c0651393e60 req-fba4a200-3851-4114-9b1c-6cc2391c7996 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3433595 Nov 11 11:53:06.136165 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:06.141469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:06.462795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event deleted for resources: {'Port': ['ID=7330e3ff-bb68-439e-a213-3f2b9a383c0e,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:06.470691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.329s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:06.571678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 7d814c54-0cf1-43cc-a16a-8adadf324bde no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:53:06.598315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for floatingip, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:06.611849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 7d814c54-0cf1-43cc-a16a-8adadf324bde {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:53:06.612358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 7d814c54-0cf1-43cc-a16a-8adadf324bde not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:53:06.617642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f653b0-aebd-4419-aa8f-c7265b139c7c req-e2543083-ee2e-462c-8606-15df24bd6225 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:06.619358 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40f653b0-aebd-4419-aa8f-c7265b139c7c req-e2543083-ee2e-462c-8606-15df24bd6225 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 944 time: 0.2025459 Nov 11 11:53:06.627300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:06.628536 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b5e48923-7d4d-47f1-aa56-88626e4801e0 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "DELETE /v2.0/floatingips/b5b43a38-2aac-48cf-8d33-e058b0d90c9b HTTP/1.1" status: 204 len: 168 time: 1.5330570 Nov 11 11:53:06.683452 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-40f653b0-aebd-4419-aa8f-c7265b139c7c req-1cb223dd-c15e-4525-a687-d696c434ef5b tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535517 Nov 11 11:53:08.027870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-5fb16b2d-457f-4ebc-a63c-582ae021e702 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:08.029505 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-5fb16b2d-457f-4ebc-a63c-582ae021e702 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 814 time: 0.2239215 Nov 11 11:53:08.039936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784ae856-85d2-425e-a514-c2626135528b req-d91978dd-747d-489b-b027-4fb3979e7127 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:08.041392 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-784ae856-85d2-425e-a514-c2626135528b req-d91978dd-747d-489b-b027-4fb3979e7127 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 944 time: 0.2084641 Nov 11 11:53:08.078270 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-1f2a19f9-4dfe-43ab-a8cd-29e9f5b2bc60 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/quotas/9c2955dc91344feaaa33bc192608a822 HTTP/1.1" status: 200 len: 375 time: 0.0358038 Nov 11 11:53:08.132859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40556) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:08.149852 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-784ae856-85d2-425e-a514-c2626135528b req-1b0bc9f3-4932-4d20-a7bc-f298560dce42 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961320 Nov 11 11:53:08.189661 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-53ab2d91-3c0a-4c5c-97cc-221e6434c4dd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0996876 Nov 11 11:53:08.234458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1a03a368-4ad6-4d92-95f1-833e8a409565 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:08.266628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1a03a368-4ad6-4d92-95f1-833e8a409565 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:08.338260 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-1713451f-04e7-4bc1-a249-f40bcb5a1a0a service neutron] 10.222.0.11 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1400995 Nov 11 11:53:08.468272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1a03a368-4ad6-4d92-95f1-833e8a409565 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:08.473867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c2fcc4a8-8c93-4670-aada-a645f120d812 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:08.490492 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-c8ce7d69-d208-4010-89cb-2119066f4386 service neutron] 10.222.0.11 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1462629 Nov 11 11:53:08.491115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a03a368-4ad6-4d92-95f1-833e8a409565 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=82ca2c36-3087-406f-9689-58bdf145dcc0,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:08.494341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1a03a368-4ad6-4d92-95f1-833e8a409565 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:08.495329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1a03a368-4ad6-4d92-95f1-833e8a409565 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:08.496857 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1a03a368-4ad6-4d92-95f1-833e8a409565 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] 10.222.0.11 "DELETE /v2.0/security-groups/82ca2c36-3087-406f-9689-58bdf145dcc0 HTTP/1.1" status: 204 len: 168 time: 0.3625505 Nov 11 11:53:08.599707 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 370e3435-46b3-4afc-bb1d-6461d4bd991b details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:53:08.642087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40562) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:08.750034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 370e3435-46b3-4afc-bb1d-6461d4bd991b, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:08.765218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'port_id': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'mac_address': 'fa:16:3e:e5:7e:7f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1043, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:53:08.823299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:08.846470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 370e3435-46b3-4afc-bb1d-6461d4bd991b {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:53:08.862487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 370e3435-46b3-4afc-bb1d-6461d4bd991b, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:08.885509 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cfa63668-ffad-440e-b4d5-dfe83fa4c1de req-01943cca-aab5-42dc-b985-3e5005f4ac75 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 210 time: 0.1132708 Nov 11 11:53:08.902504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:08.905503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:08.990967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=370e3435-46b3-4afc-bb1d-6461d4bd991b,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:09.004287 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.004798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.005184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.005567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.006035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.006687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.006687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.007039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.007385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.007753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.008116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:53:09.012443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:09.261661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:09.268653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['370e3435-46b3-4afc-bb1d-6461d4bd991b'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:53:09.523704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a4cb8-dce9-4934-aa54-d5c5b46a8c09 req-f81a38f8-0bcf-477c-9c71-34e2c91e3b6f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:09.525337 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-906a4cb8-dce9-4934-aa54-d5c5b46a8c09 req-f81a38f8-0bcf-477c-9c71-34e2c91e3b6f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 945 time: 0.1788805 Nov 11 11:53:09.600781 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-906a4cb8-dce9-4934-aa54-d5c5b46a8c09 req-322d142a-65be-4c52-9623-89a4d980dd02 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672276 Nov 11 11:53:10.022658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-752943a3-3a99-4a26-aa69-a709ff956efa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:10.121235 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0363d34a-1998-492d-83fb-a1183b55caf0 req-fce2e22f-66f2-4274-ac21-7f66a6e0e20a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 210 time: 0.0636451 Nov 11 11:53:10.134292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Deleting port 591fa385-fa3e-401b-9805-c6a8d6414fa3 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:10.134673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:10.321881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] For port 591fa385-fa3e-401b-9805-c6a8d6414fa3, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=591fa385-fa3e-401b-9805-c6a8d6414fa3,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:10.322554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:10.452262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Calling delete_port for 591fa385-fa3e-401b-9805-c6a8d6414fa3 owned by network:router_interface {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:10.604530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 370e3435-46b3-4afc-bb1d-6461d4bd991b up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:53:10.731795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 370e3435-46b3-4afc-bb1d-6461d4bd991b completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:53:10.739273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 370e3435-46b3-4afc-bb1d-6461d4bd991b triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:53:10.740185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:10.900346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:10.930990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:10.941559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 370e3435-46b3-4afc-bb1d-6461d4bd991b, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:10.977389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:10.980666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:11.015352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-a70ecddd-d9f1-46c7-a8e1-b0007aa44916 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:11.016932 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-a70ecddd-d9f1-46c7-a8e1-b0007aa44916 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 814 time: 0.5352886 Nov 11 11:53:11.021330 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'code': 200} Nov 11 11:53:11.048165 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Request body: {'port': {'device_id': 'c611a479-1519-4b89-822b-fd2ba5ed559e', 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'admin_state_up': True, 'tenant_id': '9c2955dc91344feaaa33bc192608a822'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:11.060171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=370e3435-46b3-4afc-bb1d-6461d4bd991b,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:11.063814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:11.098560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e60ba0-22af-4581-92d5-d666318f53f7 req-94ff0111-272d-475e-95f9-fd5bc309bc33 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:11.100199 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-44e60ba0-22af-4581-92d5-d666318f53f7 req-94ff0111-272d-475e-95f9-fd5bc309bc33 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.2055032 Nov 11 11:53:11.280995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:11.358227 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-44e60ba0-22af-4581-92d5-d666318f53f7 req-ef38e054-d17d-4149-80bc-5a95bc529f9f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2486391 Nov 11 11:53:11.359050 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-91ba6ce4-73a5-4dc2-9b02-81c9f53442d7 req-c478b7a7-3a63-4583-a9cb-11a46385adf8 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1099 time: 0.0885081 Nov 11 11:53:11.364934 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-68b65d60-aa68-4816-813c-2c702668cf97 req-21323e81-889d-473e-a324-07a1012d39c9 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 210 time: 0.0905554 Nov 11 11:53:11.377918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:11.393941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:11.401380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:11.407682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8bdab2b7-667b-48bb-8ee6-f2899569c47b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:11.436860 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-91ba6ce4-73a5-4dc2-9b02-81c9f53442d7 req-f91aa68b-b92a-4e9f-83fe-3d3c8cd740de service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706713 Nov 11 11:53:11.457003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Made reservation on behalf of 9c2955dc91344feaaa33bc192608a822 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:53:11.462745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:11.477371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Pushing event deleted for resources: {'Port': ['ID=591fa385-fa3e-401b-9805-c6a8d6414fa3,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:11.484503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:11.835572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Allocated IP 172.20.0.14 (b92aaf3b-0783-47c5-8158-f0c34b4d4466/52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266/d9832190-38d9-40fb-b1b9-f953eebfb4b8) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:53:12.163702 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:12.167593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:12.341202 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:12.357757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-82c8251a-a7a5-4b19-abd5-1b45c9dc6f26 tempest-ServerRescueNegativeTestJSON-42581823 tempest-ServerRescueNegativeTestJSON-42581823-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:12.358704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['52672ac7-2b99-4bcd-8a42-9c6e53617d59', '80f4cc1c-ab72-48bf-8095-c5835e08bfc3'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:53:12.447808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Network b92aaf3b-0783-47c5-8158-f0c34b4d4466 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:53:12.453544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Pushing event updated for resources: {'Port': ['ID=d9832190-38d9-40fb-b1b9-f953eebfb4b8,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:12.456270 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:53:12.458252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:12.470334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:53:12.547730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:12.548449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:12.789793 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-557240a9-4605-4f3b-b53e-1e31128f42aa tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7472546 Nov 11 11:53:12.863381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Request body: {'port': {'device_id': 'c611a479-1519-4b89-822b-fd2ba5ed559e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:13.187713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9b1f96-0b97-4015-b9be-db4fc52335c5 req-de767be2-f13a-4fb4-abda-5aa0803aa446 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:13.189231 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5a9b1f96-0b97-4015-b9be-db4fc52335c5 req-de767be2-f13a-4fb4-abda-5aa0803aa446 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.6350861 Nov 11 11:53:13.230051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5dfb91-4dd6-455d-b964-984702608442 req-9f3cb61d-2a4a-4911-a932-1b66e7cf1980 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:13.230788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-ca5dfb91-4dd6-455d-b964-984702608442 req-9f3cb61d-2a4a-4911-a932-1b66e7cf1980 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Synchronizing usage tracker for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:53:13.367057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-ca5dfb91-4dd6-455d-b964-984702608442 req-9f3cb61d-2a4a-4911-a932-1b66e7cf1980 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Unset dirty status for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:53:13.368386 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ca5dfb91-4dd6-455d-b964-984702608442 req-9f3cb61d-2a4a-4911-a932-1b66e7cf1980 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 932 time: 0.8113058 Nov 11 11:53:13.378757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:13.426346 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5a9b1f96-0b97-4015-b9be-db4fc52335c5 req-25084b62-5456-4878-b96a-1434422d0347 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1901174 Nov 11 11:53:13.491305 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-47abe0bf-bf23-4c6c-a565-52c21f6b3ee9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:13.511096 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ca5dfb91-4dd6-455d-b964-984702608442 req-7b859e1f-b5be-40e6-9f12-5fb261a9309a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1190369 Nov 11 11:53:13.525948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:13.846839 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Router e7a84a32-cf44-4d0e-908d-7569d000b45d has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:53:13.993259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d9832190-38d9-40fb-b1b9-f953eebfb4b8 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:53:14.001946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:14.022931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Transition to ACTIVE for port object d9832190-38d9-40fb-b1b9-f953eebfb4b8 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:53:14.090184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:14.100484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-99efc8aa-a8a0-4c20-af9b-6fc5024cb631 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:14.235711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Pushing event updated for resources: {'Port': ['ID=d9832190-38d9-40fb-b1b9-f953eebfb4b8,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:14.240662 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:14.369366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:53:14.376884 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] 10.222.0.11 "PUT /v2.0/routers/e7a84a32-cf44-4d0e-908d-7569d000b45d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7335031 Nov 11 11:53:14.379465 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] Sync routers for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:53:14.379633 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40596) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:14.392357 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:53:14.393037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:53:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:14.440512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Attempting to bind port d9832190-38d9-40fb-b1b9-f953eebfb4b8 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:53:14.440900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Attempting to bind port d9832190-38d9-40fb-b1b9-f953eebfb4b8 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:53:14.441275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Attempting to bind port d9832190-38d9-40fb-b1b9-f953eebfb4b8 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:53:14.461468 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Port d9832190-38d9-40fb-b1b9-f953eebfb4b8 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:53:14.461836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Attempting to bind port d9832190-38d9-40fb-b1b9-f953eebfb4b8 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:53:14.476036 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 53, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:53:14.476769 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Checking segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:53:14.476879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Bound using segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:53:14.477285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Bound port: d9832190-38d9-40fb-b1b9-f953eebfb4b8, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:53:14.477645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:14.776164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:14.781772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] For port d9832190-38d9-40fb-b1b9-f953eebfb4b8, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:53:14.786277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:53:14.787390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] For port d9832190-38d9-40fb-b1b9-f953eebfb4b8, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d9832190-38d9-40fb-b1b9-f953eebfb4b8,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:53:14.815540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:14.821197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bb5ce2d4-68cc-450c-b5ef-26c9fc88c552 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:14.917659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc46ae65-4a77-49ba-8539-50a401b07590 req-24931177-13d4-4079-89af-25b1d5d7afc3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:14.919296 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc46ae65-4a77-49ba-8539-50a401b07590 req-24931177-13d4-4079-89af-25b1d5d7afc3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.3043895 Nov 11 11:53:14.928209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:14.929660 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] 10.222.0.60 "PUT /v2.0/ports/d9832190-38d9-40fb-b1b9-f953eebfb4b8 HTTP/1.1" status: 200 len: 1094 time: 2.0820718 Nov 11 11:53:14.940499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c611a479-1519-4b89-822b-fd2ba5ed559e', 'tag': 'd9832190-38d9-40fb-b1b9-f953eebfb4b8'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:14.974603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f806ad9-e80c-40c1-b8d7-ed79ed17268c req-684dfce5-a690-44d4-a8ae-663215347cb5 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:14.976249 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7f806ad9-e80c-40c1-b8d7-ed79ed17268c req-684dfce5-a690-44d4-a8ae-663215347cb5 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 944 time: 0.2887537 Nov 11 11:53:14.993614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Pushing event updated for resources: {'Port': ['ID=d9832190-38d9-40fb-b1b9-f953eebfb4b8,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:15.015063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks [] for router, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:15.075497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:15.122808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:53:11Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:15.127608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] Checking router: e7a84a32-cf44-4d0e-908d-7569d000b45d for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:53:15.141175 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] Routers {'e7a84a32-cf44-4d0e-908d-7569d000b45d'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:53:15.141877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:53:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['e7a84a32-cf44-4d0e-908d-7569d000b45d'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:15.182668 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc46ae65-4a77-49ba-8539-50a401b07590 req-df0075b0-0c38-4075-8906-78d55bed3712 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2502787 Nov 11 11:53:15.193544 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7f806ad9-e80c-40c1-b8d7-ed79ed17268c req-64d742ae-ec83-42b0-a8b2-be381302016e tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2070343 Nov 11 11:53:15.359242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] Set router e7a84a32-cf44-4d0e-908d-7569d000b45d gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:53:15.512402 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c611a479-1519-4b89-822b-fd2ba5ed559e', 'tag': 'd9832190-38d9-40fb-b1b9-f953eebfb4b8', 'status': 'completed', 'code': 200} Nov 11 11:53:15.574962 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-f62a0cf4-7c6d-4345-9a3a-70805706386e service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 1097 time: 0.5007987 Nov 11 11:53:15.665271 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-d00c154a-41c7-4c3e-a3cb-cc5151410a24 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d9832190-38d9-40fb-b1b9-f953eebfb4b8 HTTP/1.1" status: 200 len: 217 time: 0.0793073 Nov 11 11:53:15.686897 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:53:11Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:15.691786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45d207dc-6c5e-4dea-b4c2-e4884b279651 None None] The sync data for ids ['e7a84a32-cf44-4d0e-908d-7569d000b45d'] in dv-cinder-817417-1-iscsi is: [{'id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'name': 'tempest-TestVolumeBootPattern-1826005561-router', 'tenant_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:50Z', 'updated_at': '2021-11-11T11:53:11Z', 'revision_number': 5, 'project_id': '1bcfb2b970f34aa9af017e16d6e4c699', 'gw_port': {'id': '75c7dfeb-1d5b-460b-be21-2836e4686888', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7a84a32-cf44-4d0e-908d-7569d000b45d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:42:51Z', 'updated_at': '2021-11-11T11:42:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:53:15.764105 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac879b70-32c8-4d8e-9710-19aceef5d36b req-d8ad5554-4b4f-4b61-9119-632e6f686d3c tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:15.765669 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ac879b70-32c8-4d8e-9710-19aceef5d36b req-d8ad5554-4b4f-4b61-9119-632e6f686d3c tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.2554297 Nov 11 11:53:15.802059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-98d193b3-98f4-4632-876a-422c6f60169c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:15.803671 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-98d193b3-98f4-4632-876a-422c6f60169c service neutron] 10.222.0.60 "GET /v2.0/subnets?id=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 HTTP/1.1" status: 200 len: 854 time: 0.1211739 Nov 11 11:53:15.877284 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-1b926b43-24d6-404e-a060-890921683269 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=b92aaf3b-0783-47c5-8158-f0c34b4d4466&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0654380 Nov 11 11:53:15.880864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:15.922501 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ac879b70-32c8-4d8e-9710-19aceef5d36b req-02af1d9b-ab0a-483c-b368-2af2c0c59264 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433856 Nov 11 11:53:16.010469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Deleting port 75c7dfeb-1d5b-460b-be21-2836e4686888 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:16.012771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:16.143213 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-221a7458-a43a-4127-93be-d36605c716b5 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2570348 Nov 11 11:53:16.465010 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] For port 75c7dfeb-1d5b-460b-be21-2836e4686888, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=75c7dfeb-1d5b-460b-be21-2836e4686888,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:16.465424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:16.601069 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4412c4b1-c428-49cd-8c9f-c66153ed2c9c req-f927ebf3-9796-4e1c-a9ad-eccb881bc652 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4114630 Nov 11 11:53:16.610892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Calling delete_port for 75c7dfeb-1d5b-460b-be21-2836e4686888 owned by network:router_gateway {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:16.762783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 591fa385-fa3e-401b-9805-c6a8d6414fa3 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:53:16.774881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa34b647-7cf1-411c-97e4-07a1820a6dea req-be350c4e-c564-4527-a3af-3f186d41b563 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:16.776591 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fa34b647-7cf1-411c-97e4-07a1820a6dea req-be350c4e-c564-4527-a3af-3f186d41b563 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.4577360 Nov 11 11:53:16.794682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fff03f2-1185-4f65-93cc-b1e889cb2fa4 req-15660414-1c13-4303-ad51-41714f905918 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:16.796401 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7fff03f2-1185-4f65-93cc-b1e889cb2fa4 req-15660414-1c13-4303-ad51-41714f905918 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 944 time: 0.4164097 Nov 11 11:53:16.803052 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 591fa385-fa3e-401b-9805-c6a8d6414fa3 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:53:16.803424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 591fa385-fa3e-401b-9805-c6a8d6414fa3 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:53:16.924054 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fa34b647-7cf1-411c-97e4-07a1820a6dea req-f44e4d5e-a456-4530-ade3-841c5dcc3eb4 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1358891 Nov 11 11:53:16.929584 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7fff03f2-1185-4f65-93cc-b1e889cb2fa4 req-41078696-ef20-4df1-9c50-44cc68b680c9 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1068103 Nov 11 11:53:16.936430 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-3715b61f-1c7f-45f7-9199-9671dcde83c9 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 1097 time: 0.2414300 Nov 11 11:53:17.143472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-dd026216-2df9-434c-b02f-a505202c4463 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:17.145071 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-dd026216-2df9-434c-b02f-a505202c4463 service neutron] 10.222.0.60 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 916 time: 0.2018440 Nov 11 11:53:17.214597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:17.226149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bb2be060-bcee-4afe-b116-9d71a449f174 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:17.271570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Pushing event deleted for resources: {'Port': ['ID=75c7dfeb-1d5b-460b-be21-2836e4686888,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:17.274388 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-62c94313-d1e6-4376-8f37-05631657651c service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d9832190-38d9-40fb-b1b9-f953eebfb4b8 HTTP/1.1" status: 200 len: 217 time: 0.1208780 Nov 11 11:53:17.275338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:17.424586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-c1a4407d-f357-4826-be23-5f32211a780f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:17.426133 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-c1a4407d-f357-4826-be23-5f32211a780f service neutron] 10.222.0.60 "GET /v2.0/subnets?id=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 HTTP/1.1" status: 200 len: 854 time: 0.1176987 Nov 11 11:53:17.837198 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-74a47d3e-2713-47bd-97d8-207bdd187c23 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=b92aaf3b-0783-47c5-8158-f0c34b4d4466&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3415453 Nov 11 11:53:17.866454 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:18.282984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:18.312025 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-d1be2869-4d5a-45bb-9859-39660d85724e service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4664011 Nov 11 11:53:18.313528 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:18.455180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45aecfcd-4471-4f6b-a557-4d420d22d8fb req-d5744328-e109-43a8-befb-99713b7318df tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:18.456946 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45aecfcd-4471-4f6b-a557-4d420d22d8fb req-d5744328-e109-43a8-befb-99713b7318df tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 944 time: 0.3826897 Nov 11 11:53:18.543380 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-67851867-8edb-4d9a-aec2-410cdf83fb0b req-838c4447-2b93-4d97-be8d-929225019234 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2240279 Nov 11 11:53:18.545776 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-45aecfcd-4471-4f6b-a557-4d420d22d8fb req-66e77e28-7bcd-4a2e-a948-27495226729f tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797896 Nov 11 11:53:18.590729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:18.591412 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e7a84a32-cf44-4d0e-908d-7569d000b45d {{(pid=88329) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 11:53:18.605078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Notify callbacks [] for router, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:18.608023 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] 10.222.0.11 "DELETE /v2.0/routers/e7a84a32-cf44-4d0e-908d-7569d000b45d HTTP/1.1" status: 204 len: 168 time: 4.2268460 Nov 11 11:53:18.610330 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40624) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:18.682740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] Deleting subnet 6e9509c6-37ce-4e40-8036-e5d45e65095d {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:53:18.686218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:18.740886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036850920695'] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:18.831599 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.111352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2678040', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2638849'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.116894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0b042c45-2251-4aca-87a7-98d941223576 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:19.158178 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6e9509c6-37ce-4e40-8036-e5d45e65095d,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:19.160952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:19.163809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.170053 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3baf030b-0fd3-44ad-bbfe-accdfbc95f76 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/6e9509c6-37ce-4e40-8036-e5d45e65095d HTTP/1.1" status: 204 len: 168 time: 0.5581758 Nov 11 11:53:19.172735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40638) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:19.174873 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78c7c670-b8ad-4abb-99a4-f6fd83bded62 None None] Network d5ec5e34-ac26-4927-b077-b0742eacb0fd requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:53:19.286936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.298451 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Deleting port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:19.298834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.443880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] DHCP port deletion for d5ec5e34-ac26-4927-b077-b0742eacb0fd request from dv-cinder-817417-1-iscsi {{(pid=88330) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:247}} Nov 11 11:53:19.448595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] Deleting port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:19.449022 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.537163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] For port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=1f35d8de-3bb7-492a-ad28-3aa45d51adb1,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:19.537565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.707300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Calling delete_port for 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 owned by network:dhcp {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:19.725291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] For port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=1f35d8de-3bb7-492a-ad28-3aa45d51adb1,segment=NetworkSegment(dd4c3e53-e470-48d8-b1d2-0460f04c87ff),segment_id=dd4c3e53-e470-48d8-b1d2-0460f04c87ff)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:19.725962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.806267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85cfbf1a-3cb9-40fa-a8d4-4da5ad0dcfa0 req-a274b084-448c-4f1c-9371-e037f37ea535 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:19.809649 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-85cfbf1a-3cb9-40fa-a8d4-4da5ad0dcfa0 req-a274b084-448c-4f1c-9371-e037f37ea535 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 944 time: 0.1192970 Nov 11 11:53:19.820020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:19.825640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5ae88bcf-7162-42b6-a624-aad912f0e455 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:19.865680 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-85cfbf1a-3cb9-40fa-a8d4-4da5ad0dcfa0 req-8e6ab3d6-a302-42f9-b702-4177ba7bca0b tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484016 Nov 11 11:53:19.874749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Pushing event deleted for resources: {'Port': ['ID=1f35d8de-3bb7-492a-ad28-3aa45d51adb1,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:19.880414 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:19.880640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] Calling delete_port for 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 owned by network:dhcp {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:19.885658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] No DVR routers for this DVR port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 on host dv-cinder-817417-1-iscsi {{(pid=88328) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:53:19.961963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:53:19.962421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:53:20.018731 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:20.046221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d5ec5e34-ac26-4927-b077-b0742eacb0fd']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:20.060723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:20.061059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dd4c3e53-e470-48d8-b1d2-0460f04c87ff') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:20.074111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:20.089723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:20.096971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Releasing vlan 1015 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:53:20.097410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:53:20.112208 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:53:20.282973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:20.286648 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:20.301304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:20.312297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Pushing event deleted for resources: {'Network': ['ID=d5ec5e34-ac26-4927-b077-b0742eacb0fd,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:20.317313 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:20.322846 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-09f32147-bb82-43bf-b5e6-4f0d156b6c82 admin admin] 10.222.0.11 "DELETE /v2.0/networks/d5ec5e34-ac26-4927-b077-b0742eacb0fd HTTP/1.1" status: 204 len: 168 time: 1.1490729 Nov 11 11:53:20.325990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40650) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:20.464026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] Deleting port 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:20.464511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:20.537992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41b44fa9-b91e-4122-a7ee-db098d502bb8 None None] The port '1f35d8de-3bb7-492a-ad28-3aa45d51adb1' was deleted {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1877}} Nov 11 11:53:20.648300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device d9832190-38d9-40fb-b1b9-f953eebfb4b8 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:53:20.814486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:53:20.869891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:53:20.870281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 1f35d8de-3bb7-492a-ad28-3aa45d51adb1 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:53:20.870802 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 75c7dfeb-1d5b-460b-be21-2836e4686888 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:53:20.902861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port d9832190-38d9-40fb-b1b9-f953eebfb4b8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d9832190-38d9-40fb-b1b9-f953eebfb4b8,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:20.925062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 75c7dfeb-1d5b-460b-be21-2836e4686888 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:53:20.925454 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 75c7dfeb-1d5b-460b-be21-2836e4686888 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:53:20.929856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': 'd9832190-38d9-40fb-b1b9-f953eebfb4b8', 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'port_id': 'd9832190-38d9-40fb-b1b9-f953eebfb4b8', 'mac_address': 'fa:16:3e:b1:ff:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1024, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:53:20.999115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:21.005064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:21.023467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d9832190-38d9-40fb-b1b9-f953eebfb4b8 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:53:21.052517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port d9832190-38d9-40fb-b1b9-f953eebfb4b8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d9832190-38d9-40fb-b1b9-f953eebfb4b8,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:21.077843 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:21.081101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:21.138427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23385a3-a9f7-49fe-8e10-bca5f7bb8efd req-819ab777-b44f-44c4-aceb-6768286c00b6 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:21.140167 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a23385a3-a9f7-49fe-8e10-bca5f7bb8efd req-819ab777-b44f-44c4-aceb-6768286c00b6 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 945 time: 0.0963984 Nov 11 11:53:21.153159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=d9832190-38d9-40fb-b1b9-f953eebfb4b8,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:21.156665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:21.196432 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a23385a3-a9f7-49fe-8e10-bca5f7bb8efd req-afb93992-b9a1-46b5-a11d-d95c01a82d97 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484397 Nov 11 11:53:21.483224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['d9832190-38d9-40fb-b1b9-f953eebfb4b8'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:53:21.681667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Deleting port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:21.682056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:21.873221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] For port d0e644f1-77cf-4429-9b1e-d1642cbdfa7d, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,segment=NetworkSegment(78ed9e2e-e20d-42d4-a7f4-c2e4bec06612),segment_id=78ed9e2e-e20d-42d4-a7f4-c2e4bec06612)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:21.873544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:22.008286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Calling delete_port for d0e644f1-77cf-4429-9b1e-d1642cbdfa7d owned by network:router_interface {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:22.214581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:22.219239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c21862e8-ef65-4471-b3f2-b6ca7d61b9c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:22.262129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Pushing event deleted for resources: {'Port': ['ID=d0e644f1-77cf-4429-9b1e-d1642cbdfa7d,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:22.265230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:22.416991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe43e2f2-7abc-45f3-9a16-ead0517b9285 req-25aaa7bb-d1f2-4c4d-98eb-237c95dcb690 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:22.418663 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fe43e2f2-7abc-45f3-9a16-ead0517b9285 req-25aaa7bb-d1f2-4c4d-98eb-237c95dcb690 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 945 time: 0.0867569 Nov 11 11:53:22.472253 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fe43e2f2-7abc-45f3-9a16-ead0517b9285 req-1628d1d7-ebd2-4f2c-81b5-8533257bd5ee tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464609 Nov 11 11:53:22.575233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:22.663842 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device d9832190-38d9-40fb-b1b9-f953eebfb4b8 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:53:22.769666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port d9832190-38d9-40fb-b1b9-f953eebfb4b8 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:53:22.775205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port d9832190-38d9-40fb-b1b9-f953eebfb4b8 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:53:22.775629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:22.895483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:22.924826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c611a479-1519-4b89-822b-fd2ba5ed559e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9832190-38d9-40fb-b1b9-f953eebfb4b8'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:22.935541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port d9832190-38d9-40fb-b1b9-f953eebfb4b8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d9832190-38d9-40fb-b1b9-f953eebfb4b8,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:22.964148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:22.968828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-90b47402-d57e-4d9b-8cef-35595504c40d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:23.008654 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c611a479-1519-4b89-822b-fd2ba5ed559e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9832190-38d9-40fb-b1b9-f953eebfb4b8', 'code': 200} Nov 11 11:53:23.053530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=d9832190-38d9-40fb-b1b9-f953eebfb4b8,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:23.057035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:23.191448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Router a03778cc-5501-4f10-ad17-ba4d2c2980e0 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:53:23.325951 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e25d284-2f13-41e1-923f-2a4d1f62e72a req-d6a4e49b-c291-4f22-a143-f79d45f70df7 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 1099 time: 0.0774267 Nov 11 11:53:23.372253 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e25d284-2f13-41e1-923f-2a4d1f62e72a req-12b225cf-11c2-401f-8131-4a2e11cc5d2a service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386424 Nov 11 11:53:23.401678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:53:23.412259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] Sync routers for ids ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:53:23.424830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] Routers {'a03778cc-5501-4f10-ad17-ba4d2c2980e0'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:53:23.425546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:53:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:23.499826 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] 10.222.0.11 "PUT /v2.0/routers/a03778cc-5501-4f10-ad17-ba4d2c2980e0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1702418 Nov 11 11:53:23.500129 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40666) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:23.701344 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58fc1e1d-d3f0-4094-a171-aabcf58b7f32 req-48b3b472-847d-41f5-87c1-bb1eaf783c56 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:23.703064 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-58fc1e1d-d3f0-4094-a171-aabcf58b7f32 req-48b3b472-847d-41f5-87c1-bb1eaf783c56 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 946 time: 0.0893483 Nov 11 11:53:23.757852 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-58fc1e1d-d3f0-4094-a171-aabcf58b7f32 req-d284fa8c-6ea7-427e-ab2b-83eba7dec519 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466747 Nov 11 11:53:23.778836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] Set router a03778cc-5501-4f10-ad17-ba4d2c2980e0 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:53:23.954096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks [] for router, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:24.080738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:53:22Z', 'revision_number': 5, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:24.084686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] Checking router: a03778cc-5501-4f10-ad17-ba4d2c2980e0 for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:53:24.095594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] Routers {'a03778cc-5501-4f10-ad17-ba4d2c2980e0'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:53:24.096276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:53:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:24.165849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:24.203805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Deleting port 89241b8c-96f0-4409-873c-7c7a4b4ec63b {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:24.204256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:24.286144 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] Set router a03778cc-5501-4f10-ad17-ba4d2c2980e0 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:53:24.390355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] For port 89241b8c-96f0-4409-873c-7c7a4b4ec63b, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=89241b8c-96f0-4409-873c-7c7a4b4ec63b,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:24.390970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:24.519388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Calling delete_port for 89241b8c-96f0-4409-873c-7c7a4b4ec63b owned by network:router_gateway {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:24.585212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:53:22Z', 'revision_number': 5, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:24.589356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0f8e86d-9f46-45f1-b105-4cd36ec3e554 None None] The sync data for ids ['a03778cc-5501-4f10-ad17-ba4d2c2980e0'] in dv-cinder-817417-1-iscsi is: [{'id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'name': 'tempest-TestVolumeBootPattern-404019582-router', 'tenant_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:42:58Z', 'updated_at': '2021-11-11T11:53:22Z', 'revision_number': 5, 'project_id': 'cfdc6b30588547c7b66704fb3a697c2e', 'gw_port': {'id': '89241b8c-96f0-4409-873c-7c7a4b4ec63b', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:1e:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a03778cc-5501-4f10-ad17-ba4d2c2980e0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:43:00Z', 'updated_at': '2021-11-11T11:43:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:53:24.712737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:24.717722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2bf901bd-84b1-44fd-97a5-05f05f11b75f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:24.760852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Pushing event deleted for resources: {'Port': ['ID=89241b8c-96f0-4409-873c-7c7a4b4ec63b,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:24.765157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:24.766204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device d0e644f1-77cf-4429-9b1e-d1642cbdfa7d no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:53:24.805829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: d0e644f1-77cf-4429-9b1e-d1642cbdfa7d {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:53:24.806219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device d0e644f1-77cf-4429-9b1e-d1642cbdfa7d not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:53:24.989372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cf93186-ea68-476f-a507-92f307b3ac2a req-34253f86-2997-430b-b27f-d9bb6d99458b tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:24.991064 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9cf93186-ea68-476f-a507-92f307b3ac2a req-34253f86-2997-430b-b27f-d9bb6d99458b tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 946 time: 0.0906055 Nov 11 11:53:25.031886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.048491 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9cf93186-ea68-476f-a507-92f307b3ac2a req-72d6fe55-b6ca-4d76-aa69-b05697311ec6 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504196 Nov 11 11:53:25.301876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.306309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.547050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.547718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Fanout notify agent at l3_agent the message router_deleted on router a03778cc-5501-4f10-ad17-ba4d2c2980e0 {{(pid=88328) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 11:53:25.561794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.565634 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ea0bebda-fe07-4851-af74-e24b8de690eb admin admin] 10.222.0.11 "DELETE /v2.0/routers/a03778cc-5501-4f10-ad17-ba4d2c2980e0 HTTP/1.1" status: 204 len: 168 time: 2.0618763 Nov 11 11:53:25.565985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40678) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:25.634374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] Deleting subnet f9a4a053-ae53-47ec-a7c1-8726ce54ecda {{(pid=88329) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:53:25.637772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.696737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852055773'] for subnet, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.779772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.896376 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852055754', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036852017038'] for subnet, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.901529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:25.940249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f9a4a053-ae53-47ec-a7c1-8726ce54ecda,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:25.943219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:25.951760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:25.952830 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d7c5deb7-e984-4aae-8d94-0ef048bb69b3 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/f9a4a053-ae53-47ec-a7c1-8726ce54ecda HTTP/1.1" status: 204 len: 168 time: 0.3856838 Nov 11 11:53:25.955461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40682) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:25.955633 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-532910d7-6aab-414f-a060-2885ceaad80b None None] Network 71ce433b-c614-4f0f-bf3e-b123f1ebde67 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:53:26.077225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:26.089104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Deleting port f50ea43a-b1f2-404e-a833-c8c1b9094abe {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:26.089488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:26.228559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] DHCP port deletion for 71ce433b-c614-4f0f-bf3e-b123f1ebde67 request from dv-cinder-817417-1-iscsi {{(pid=88330) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:247}} Nov 11 11:53:26.233340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] Deleting port f50ea43a-b1f2-404e-a833-c8c1b9094abe {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:26.234024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:26.399936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] For port f50ea43a-b1f2-404e-a833-c8c1b9094abe, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f50ea43a-b1f2-404e-a833-c8c1b9094abe,segment=NetworkSegment(78ed9e2e-e20d-42d4-a7f4-c2e4bec06612),segment_id=78ed9e2e-e20d-42d4-a7f4-c2e4bec06612)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:26.400353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:26.475042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4048c5-dc54-45d3-b817-fe926d212a7b req-97152ecb-cc68-4e84-b17b-423bc2e7bb3c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:26.476705 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6f4048c5-dc54-45d3-b817-fe926d212a7b req-97152ecb-cc68-4e84-b17b-423bc2e7bb3c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 946 time: 0.3007402 Nov 11 11:53:26.543743 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Calling delete_port for f50ea43a-b1f2-404e-a833-c8c1b9094abe owned by network:dhcp {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:26.637316 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6f4048c5-dc54-45d3-b817-fe926d212a7b req-42195a9b-f3da-4ad5-9ca5-8b988a80344a tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014209 Nov 11 11:53:26.637864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] For port f50ea43a-b1f2-404e-a833-c8c1b9094abe, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f50ea43a-b1f2-404e-a833-c8c1b9094abe,segment=NetworkSegment(78ed9e2e-e20d-42d4-a7f4-c2e4bec06612),segment_id=78ed9e2e-e20d-42d4-a7f4-c2e4bec06612)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:26.638424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:26.730335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:26.735678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:26.772659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] Calling delete_port for f50ea43a-b1f2-404e-a833-c8c1b9094abe owned by network:dhcp {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:53:26.787397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Pushing event deleted for resources: {'Port': ['ID=f50ea43a-b1f2-404e-a833-c8c1b9094abe,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:26.797634 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:26.825505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] No DVR routers for this DVR port f50ea43a-b1f2-404e-a833-c8c1b9094abe on host dv-cinder-817417-1-iscsi {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:53:26.840139 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 89241b8c-96f0-4409-873c-7c7a4b4ec63b no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:53:26.891653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 89241b8c-96f0-4409-873c-7c7a4b4ec63b {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:53:26.891978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 89241b8c-96f0-4409-873c-7c7a4b4ec63b not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:53:26.892463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f50ea43a-b1f2-404e-a833-c8c1b9094abe no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:53:26.927943 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: f50ea43a-b1f2-404e-a833-c8c1b9094abe {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:53:26.928336 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f50ea43a-b1f2-404e-a833-c8c1b9094abe not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:53:26.932118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:53:26.932583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:53:26.965754 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:26.995664 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['71ce433b-c614-4f0f-bf3e-b123f1ebde67']}} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:27.009668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612') {'for_net_delete': True} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:27.010013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '78ed9e2e-e20d-42d4-a7f4-c2e4bec06612') {} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:27.023273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2720042'] for segment, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:27.092087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:27.100119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Releasing vlan 1009 on physical network physnet1 to pool {{(pid=88329) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:53:27.100833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2720660'] for segment, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:53:27.116398 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:53:27.434388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] Deleting port f50ea43a-b1f2-404e-a833-c8c1b9094abe {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:53:27.434814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:27.444918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:27.449068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:27.465649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:27.475266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Pushing event deleted for resources: {'Network': ['ID=71ce433b-c614-4f0f-bf3e-b123f1ebde67,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:27.479887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:27.486517 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] 10.222.0.11 "DELETE /v2.0/networks/71ce433b-c614-4f0f-bf3e-b123f1ebde67 HTTP/1.1" status: 204 len: 168 time: 1.5299466 Nov 11 11:53:27.505556 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c56a748e-fbf7-42b2-8fdd-4ff3d17aa7ac None None] The port 'f50ea43a-b1f2-404e-a833-c8c1b9094abe' was deleted {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1877}} Nov 11 11:53:27.899708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40706) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:28.011664 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-35393bbd-c7ab-40e2-ac5f-3d162e182745 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=1bcfb2b970f34aa9af017e16d6e4c699&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1104476 Nov 11 11:53:28.014315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40710) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:28.037757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8684853c-f715-498a-a5c7-5b9b866dfd37 req-ce5b769e-4e58-48c6-b909-ca72890de30d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:28.039404 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8684853c-f715-498a-a5c7-5b9b866dfd37 req-ce5b769e-4e58-48c6-b909-ca72890de30d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.1211195 Nov 11 11:53:28.084941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf1936bb-567d-47db-b8c5-e9b326752527 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:28.090073 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8684853c-f715-498a-a5c7-5b9b866dfd37 req-e4ba4ef6-8969-4151-8690-dd064be8ff16 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443976 Nov 11 11:53:28.112816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf1936bb-567d-47db-b8c5-e9b326752527 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:28.118760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40714) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:28.227914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf1936bb-567d-47db-b8c5-e9b326752527 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:28.233390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1a03a368-4ad6-4d92-95f1-833e8a409565 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:28.244863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf1936bb-567d-47db-b8c5-e9b326752527 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9462277c-1dc6-4630-933d-d7771a212a6a,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:28.248798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bf1936bb-567d-47db-b8c5-e9b326752527 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:28.252812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf1936bb-567d-47db-b8c5-e9b326752527 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:28.254012 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-bf1936bb-567d-47db-b8c5-e9b326752527 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/9462277c-1dc6-4630-933d-d7771a212a6a HTTP/1.1" status: 204 len: 168 time: 0.2386191 Nov 11 11:53:28.393274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-29a0ecf2-8ff0-435f-b923-7865c2e9ba84 tempest-TestMinimumBasicScenario-206769795 tempest-TestMinimumBasicScenario-206769795-project-admin] Synchronizing usage tracker for tenant:70fe58003dfc4c6e90cc8f7f1ec717bc on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:53:28.468476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-29a0ecf2-8ff0-435f-b923-7865c2e9ba84 tempest-TestMinimumBasicScenario-206769795 tempest-TestMinimumBasicScenario-206769795-project-admin] Unset dirty status for tenant:70fe58003dfc4c6e90cc8f7f1ec717bc on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:53:28.473007 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-29a0ecf2-8ff0-435f-b923-7865c2e9ba84 tempest-TestMinimumBasicScenario-206769795 tempest-TestMinimumBasicScenario-206769795-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1094 time: 0.3500626 Nov 11 11:53:28.473537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40724) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:28.479856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'port_id': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'tenant_id': '08033101aa064f2da647814019558d4e', 'fixed_ip_address': '172.20.0.10'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:28.486316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:28.491333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:floatingip and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:28.494612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:28.503854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:28.542542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for floatingip, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:28.703097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:28.994259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40738) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:29.075198 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ba1ad7b0-bfb7-4ced-a060-c35813acd259 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=cfdc6b30588547c7b66704fb3a697c2e&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0772991 Nov 11 11:53:29.075642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40742) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:29.139475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb89cf29-321f-4795-be24-f062f971fc1e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:29.148464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Allocated IP 172.27.3.111 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/82706613-6a97-4216-a72f-9e95d24d69ae) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:53:29.173693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb89cf29-321f-4795-be24-f062f971fc1e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:29.350418 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:29.360355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb89cf29-321f-4795-be24-f062f971fc1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:29.368630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3bee66a5-838c-47b4-82d2-f06809279ac8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:29.386978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb89cf29-321f-4795-be24-f062f971fc1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a8f9d2c-13be-4ad1-9ea7-1523bbb1e810,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:29.400275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bb89cf29-321f-4795-be24-f062f971fc1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:29.400275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bb89cf29-321f-4795-be24-f062f971fc1e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:29.400275 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-bb89cf29-321f-4795-be24-f062f971fc1e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2a8f9d2c-13be-4ad1-9ea7-1523bbb1e810 HTTP/1.1" status: 204 len: 168 time: 0.3158584 Nov 11 11:53:29.417842 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:29.424380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c408136-d014-4049-bf79-b659fa9d5625 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:29.492259 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:53:29.496204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:53:29.498719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:53:29.536067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'Port': ['ID=82706613-6a97-4216-a72f-9e95d24d69ae,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:29.539117 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:30.058083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:30.131950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:30.344680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:30.371525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:30.376138 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3c1fef62-258b-451e-a081-5d25c09b1cdc tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:30.481328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'Port': ['ID=82706613-6a97-4216-a72f-9e95d24d69ae,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:30.485725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:30.495024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:30.693093 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Floating IP 5333dcdf-b770-4ab4-9627-6a4669cba527 associated. External IP: 172.27.3.111, port: 370e3435-46b3-4afc-bb1d-6461d4bd991b. Nov 11 11:53:31.123136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Router 513d8c63-d622-434a-a3e7-a65baed1396c has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:53:31.330107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:53:31.340886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] Sync routers for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:53:31.354427 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:53:31.355103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:53:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:31.476950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:31.535996 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 3.0605247 Nov 11 11:53:31.536979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:31.539012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40754) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:31.546936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:53:31.559707 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1748416726', 'description': 'tempest-secgroup-smoke-1748416726 description', 'project_id': '08033101aa064f2da647814019558d4e'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:31.572495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:31.577641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:security_group and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:31.581449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:31.589199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:31.603110 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'status': 'completed', 'code': 200} Nov 11 11:53:31.623895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:31.662337 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:31.666343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:security_group_rule and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:31.669387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:31.675771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:31.705983 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-22e1d466-9253-4a51-8d2f-47ec60d36de8 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1099 time: 0.0769935 Nov 11 11:53:31.819078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:31.847426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:31.853935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-386c4b45-5c3f-494f-883e-2e0275e7f80e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:31.863101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-002a13d9-c819-4dbf-ba55-a39e71ffe32c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:31.864757 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-002a13d9-c819-4dbf-ba55-a39e71ffe32c service neutron] 10.222.0.60 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 917 time: 0.1511996 Nov 11 11:53:31.897510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=daef70c8-952a-438d-8bc5-0c7677b1fd83,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:31.900887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:31.930154 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '5333dcdf-b770-4ab4-9627-6a4669cba527', 'tenant_id': '08033101aa064f2da647814019558d4e', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'port_id': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'mac_address': 'fa:16:3e:e5:7e:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da29b497-f07f-4562-b681-42e65d990cba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:53:29Z', 'updated_at': '2021-11-11T11:53:29Z', 'revision_number': 0, 'project_id': '08033101aa064f2da647814019558d4e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:27Z', 'revision_number': 5, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:31.934199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] Checking router: 513d8c63-d622-434a-a3e7-a65baed1396c for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:53:31.943304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:31.948212 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.4080124 Nov 11 11:53:31.948936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40760) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:31.950326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:53:31.951227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:53:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:31.955345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'security_group_rule': {'security_group_id': 'daef70c8-952a-438d-8bc5-0c7677b1fd83', 'project_id': '08033101aa064f2da647814019558d4e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:31.961808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:31.968180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:security_group_rule and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:31.971971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:31.979385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:31.984663 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-a22fefac-7d18-4e58-8e16-c7f08e46c37a service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 1000 time: 0.1116214 Nov 11 11:53:32.037537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.055947 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-97142d02-8a3f-4a69-a1ea-1744624921ff service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:32.057530 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-97142d02-8a3f-4a69-a1ea-1744624921ff service neutron] 10.222.0.60 "GET /v2.0/subnets?id=74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 200 len: 854 time: 0.0662239 Nov 11 11:53:32.109995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.138682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.141899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-af18dd86-2690-405b-b548-3fa85b72674b tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:32.151116 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-f9a8b66a-d088-4920-8c85-e90ec49c3571 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0848417 Nov 11 11:53:32.151362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:53:32.172046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7be0e9fd-fd4b-4ada-8a08-31f0298ccf12,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:32.177287 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:32.206920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.208338 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4c29c4bf-b401-4215-ae7b-3e8ae079b45d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.2583015 Nov 11 11:53:32.211437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40764) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:32.218110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'security_group_rule': {'security_group_id': 'daef70c8-952a-438d-8bc5-0c7677b1fd83', 'project_id': '08033101aa064f2da647814019558d4e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:32.225268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:32.229319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:security_group_rule and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:32.232489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:32.239196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:32.288180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.295671 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-c3c78340-d188-4fda-bd70-f811d6fe86fd service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1377318 Nov 11 11:53:32.354418 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.395238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.398249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1ce027ae-01a2-4a3c-bf9c-32aba4b6275a tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:32.423235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=61678c1a-a341-40f9-906c-aeeeb9d79212,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:32.427092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:32.441432 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d2b0360e-55f3-4b35-b207-58421bebeaf6 req-d771e7b6-b41e-4000-b00c-ed114093f752 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1389210 Nov 11 11:53:32.463722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.465055 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-eec13525-2472-4456-8c41-d3e4e4b438e9 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.2521343 Nov 11 11:53:32.467957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 40768) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:32.474770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'security_group_rule': {'security_group_id': 'daef70c8-952a-438d-8bc5-0c7677b1fd83', 'project_id': '08033101aa064f2da647814019558d4e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:32.481397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:32.485650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:security_group_rule and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:32.489261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:32.496015 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:32.527483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '5333dcdf-b770-4ab4-9627-6a4669cba527', 'tenant_id': '08033101aa064f2da647814019558d4e', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'port_id': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'mac_address': 'fa:16:3e:e5:7e:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da29b497-f07f-4562-b681-42e65d990cba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:53:29Z', 'updated_at': '2021-11-11T11:53:29Z', 'revision_number': 0, 'project_id': '08033101aa064f2da647814019558d4e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:27Z', 'revision_number': 5, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:53:32.532453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f97b724e-df18-4822-a620-658d93c564e0 None None] The sync data for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi is: [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '5333dcdf-b770-4ab4-9627-6a4669cba527', 'tenant_id': '08033101aa064f2da647814019558d4e', 'floating_ip_address': '172.27.3.111', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'port_id': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'mac_address': 'fa:16:3e:e5:7e:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da29b497-f07f-4562-b681-42e65d990cba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:53:29Z', 'updated_at': '2021-11-11T11:53:29Z', 'revision_number': 0, 'project_id': '08033101aa064f2da647814019558d4e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:27Z', 'revision_number': 5, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:53:32.557603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.630263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.663260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.671061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:32.691094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c9aadb3e-da08-437e-ab33-c916a01ee96f,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:32.696029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:32.737287 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.738667 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e66654f0-eeaf-4fa2-bda1-aef975b0c4ff tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.2695334 Nov 11 11:53:32.742215 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40774) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:32.748963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'security_group_rule': {'security_group_id': 'daef70c8-952a-438d-8bc5-0c7677b1fd83', 'project_id': '08033101aa064f2da647814019558d4e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:32.756223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:32.760502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:security_group_rule and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:32.763605 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:32.769830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:32.820049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.894017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65ffd6e8-e1dc-4c02-950e-3d2a66d39b57 None None] New status for floating IP 5333dcdf-b770-4ab4-9627-6a4669cba527: ACTIVE {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:53:32.897589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.943986 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:32.946152 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:32.971046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4909031e-c9e8-4119-9c52-67fa5e32f501,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:32.973754 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:33.012228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.013643 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-583485f5-dfb4-408e-b7ca-104b5b142fe3 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.2703764 Nov 11 11:53:33.016567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40778) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:33.023182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'security_group_rule': {'security_group_id': 'daef70c8-952a-438d-8bc5-0c7677b1fd83', 'project_id': '08033101aa064f2da647814019558d4e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:33.029428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:33.033485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:security_group_rule and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:33.036650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:33.043380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:33.086424 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.securitygroups_db [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Project 08033101aa064f2da647814019558d4e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 11:53:33.093434 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.164206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.217844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.220037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:33.244575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=45360cd5-62ab-4b60-ba92-313f51c2c7aa,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:33.247107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:33.292201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.293501 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-7d1cd480-0049-442f-82d7-1e070834f75a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.2759361 Nov 11 11:53:33.296413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 40782) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:53:33.302516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'security_group_rule': {'security_group_id': 'daef70c8-952a-438d-8bc5-0c7677b1fd83', 'project_id': '08033101aa064f2da647814019558d4e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:33.308920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:33.312937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Usage tracker for resource:security_group_rule and tenant:08033101aa064f2da647814019558d4e is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:53:33.315995 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:53:33.322005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:33.354852 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.securitygroups_db [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Project 08033101aa064f2da647814019558d4e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 11:53:33.361438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.429436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.480791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.483021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3ba50785-6e19-454d-9ce8-8a0f90daa899 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:33.508796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=216dcd3b-2776-4ac7-a875-a58de09a36bd,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:33.514157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:33.543797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:33.545123 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4f7eb78c-40ee-4d0d-b433-4c2f44af6dfc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.2476439 Nov 11 11:53:33.687800 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-ad6a502e-7188-44d0-b542-fd771bc3c1d6 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1748416726&fields=id&tenant_id=08033101aa064f2da647814019558d4e HTTP/1.1" status: 200 len: 267 time: 0.0453179 Nov 11 11:53:33.778808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-7b2f2b89-f3ba-4f65-8006-64666c1aee83 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:33.780325 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-7b2f2b89-f3ba-4f65-8006-64666c1aee83 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.0864799 Nov 11 11:53:33.795410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'port': {'security_groups': ['091599ea-1d12-4fa6-b21a-4de8f0f3d035', 'daef70c8-952a-438d-8bc5-0c7677b1fd83']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:33.918877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:34.465261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] For port 370e3435-46b3-4afc-bb1d-6461d4bd991b, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:34.490768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:34.521712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:34.529124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-92aec042-38d8-4da4-be84-4d435e42ca57 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:34.533924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['370e3435-46b3-4afc-bb1d-6461d4bd991b'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:53:34.593829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:34.594495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:34.596858 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-069d815e-de2a-4d6a-ab40-2b9906837be0 req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "PUT /v2.0/ports/370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 982 time: 0.8067887 Nov 11 11:53:34.597425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:34.635497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'Port': ['ID=370e3435-46b3-4afc-bb1d-6461d4bd991b,revision_number=6']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:34.639249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:34.673658 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'status': 'completed', 'code': 200} Nov 11 11:53:34.685563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['370e3435-46b3-4afc-bb1d-6461d4bd991b'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:53:34.805740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:34.861779 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-66ce63db-9db6-4f8e-92f8-9d6573505d75 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1138 time: 0.1605458 Nov 11 11:53:34.872538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4821ca0-adff-4935-acc7-e91b5a268df4 req-bdb8b9e4-9e2a-4f4b-bded-abc5000e7e98 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:34.874209 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a4821ca0-adff-4935-acc7-e91b5a268df4 req-bdb8b9e4-9e2a-4f4b-bded-abc5000e7e98 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.1209600 Nov 11 11:53:35.026728 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a4821ca0-adff-4935-acc7-e91b5a268df4 req-df670e62-b609-472e-9a59-44cb1760ad8e tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1284895 Nov 11 11:53:35.032530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-f3d737b6-27ae-40d0-a862-5b73dece4821 None None] Provisioning complete for port 370e3435-46b3-4afc-bb1d-6461d4bd991b triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:53:35.032958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f3d737b6-27ae-40d0-a862-5b73dece4821 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:35.054228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-095326cc-e7be-40ac-ab86-24c0ae2fcfad service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:35.055855 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-095326cc-e7be-40ac-ab86-24c0ae2fcfad service neutron] 10.222.0.60 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 917 time: 0.1806879 Nov 11 11:53:35.182857 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-2094c2d3-82ac-4fd3-9e23-721a80f2cf10 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 1002 time: 0.1088378 Nov 11 11:53:35.256927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-9a20e036-84f2-4b87-b32b-69b5c3dc4f3e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:35.258812 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-9a20e036-84f2-4b87-b32b-69b5c3dc4f3e service neutron] 10.222.0.60 "GET /v2.0/subnets?id=74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 200 len: 854 time: 0.0686879 Nov 11 11:53:35.353554 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-5344128c-2e42-406d-b439-1900a87e2cd5 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0782769 Nov 11 11:53:35.499516 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-096a6fba-52ae-40c5-8f29-f5dac9d878c8 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1387970 Nov 11 11:53:35.657604 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cc7eff32-6fa0-4866-812f-45d5310f5e78 req-b86a5c66-820a-428b-ae57-c4bd742c8664 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1484728 Nov 11 11:53:37.612207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:53:40.019641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ee5018c6-a4f6-4366-9bb5-a508edc9dbb4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:40.504797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a67b5d55-8164-411f-8887-f59016e3d880 req-12dfa30b-b32d-4a8a-8f8c-59c5bcbe7ed6 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:40.506922 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-12dfa30b-b32d-4a8a-8f8c-59c5bcbe7ed6 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 814 time: 0.1527565 Nov 11 11:53:40.525242 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-2946cba1-9e43-4134-b2e6-c45027e1fadd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/quotas/9c2955dc91344feaaa33bc192608a822 HTTP/1.1" status: 200 len: 375 time: 0.0121648 Nov 11 11:53:40.614526 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-fb50b597-69d1-4de3-9533-0c7aee53d27d tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0832038 Nov 11 11:53:40.763491 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-bdcdcc42-321b-4a69-b5db-836fc7e383d3 service neutron] 10.222.0.11 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1396379 Nov 11 11:53:40.910124 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-04b3f5ff-ff78-4ff6-814e-067165760428 service neutron] 10.222.0.11 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1401942 Nov 11 11:53:41.247859 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-474f912d-5108-4214-8b1c-b37d14ad7bf1 req-eea8e993-9781-4b33-b121-a55bf0382b80 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 210 time: 0.0496013 Nov 11 11:53:41.260382 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:42.434069 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1df6ac75-b161-4181-9a19-d90950e1aa04 req-42122679-ec20-49a0-9fef-91d2e2c1768e tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 210 time: 0.0460114 Nov 11 11:53:43.026371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a67b5d55-8164-411f-8887-f59016e3d880 req-94a36799-63a3-4af7-bc09-71678eabbdb4 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:43.027899 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-94a36799-63a3-4af7-bc09-71678eabbdb4 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 814 time: 0.1613319 Nov 11 11:53:43.047936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Request body: {'port': {'device_id': 'd260e304-bbe8-4108-bfb9-938ad2f6d146', 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'admin_state_up': True, 'tenant_id': '9c2955dc91344feaaa33bc192608a822'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:43.192120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:53:43.202877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:53:43.249393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Made reservation on behalf of 9c2955dc91344feaaa33bc192608a822 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:53:43.254969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:43.456297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Allocated IP 172.20.0.13 (b92aaf3b-0783-47c5-8158-f0c34b4d4466/52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266/e01bc857-5126-40f2-9281-d128a5805554) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:53:43.486213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-08ca13ed-f2d4-4b7a-969d-fb6e1a979884 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:43.544556 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:43.667564 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fd86f5bf-61ed-4cc4-b543-56069c9f5974 req-c5fa4dc8-12c1-41e4-ae43-6b9d41f2293c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 210 time: 0.0602436 Nov 11 11:53:43.719610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:43.776046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:43.782051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:43.788027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['52672ac7-2b99-4bcd-8a42-9c6e53617d59', '80f4cc1c-ab72-48bf-8095-c5835e08bfc3', 'd9832190-38d9-40fb-b1b9-f953eebfb4b8'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:53:43.852696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Network b92aaf3b-0783-47c5-8158-f0c34b4d4466 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:53:43.856624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:53:43.861487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:53:43.888612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Pushing event updated for resources: {'Port': ['ID=e01bc857-5126-40f2-9281-d128a5805554,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:43.894517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:43.929641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:43.930239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:43.982282 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b92a8b2c-cd5a-4364-86c2-d01603f21d9c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9386444 Nov 11 11:53:44.189284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Request body: {'port': {'device_id': 'd260e304-bbe8-4108-bfb9-938ad2f6d146', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:53:44.302708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:44.657592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e01bc857-5126-40f2-9281-d128a5805554 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:53:44.666064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:44.682032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:44.736130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Transition to ACTIVE for port object e01bc857-5126-40f2-9281-d128a5805554 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:53:44.764670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:44.769861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:45.169351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Pushing event updated for resources: {'Port': ['ID=e01bc857-5126-40f2-9281-d128a5805554,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:45.172291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.403s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:45.293662 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8497ce-ef67-473c-b2bb-9dd239d65f5e req-3da07dba-2e94-4d11-a700-fc1e8f57dae7 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:45.294411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7d8497ce-ef67-473c-b2bb-9dd239d65f5e req-3da07dba-2e94-4d11-a700-fc1e8f57dae7 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Synchronizing usage tracker for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:53:45.320772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Attempting to bind port e01bc857-5126-40f2-9281-d128a5805554 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:53:45.321145 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Attempting to bind port e01bc857-5126-40f2-9281-d128a5805554 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:53:45.321513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Attempting to bind port e01bc857-5126-40f2-9281-d128a5805554 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:53:45.328283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Port e01bc857-5126-40f2-9281-d128a5805554 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:53:45.328644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Attempting to bind port e01bc857-5126-40f2-9281-d128a5805554 on network b92aaf3b-0783-47c5-8158-f0c34b4d4466 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:53:45.335172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 53, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:53:45.335641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Checking segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:53:45.336083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Bound using segment: {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:53:45.336544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Bound port: e01bc857-5126-40f2-9281-d128a5805554, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '48b3fee6-4c38-4975-aea7-8c618366f035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1024, 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:53:45.336926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:45.381218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7d8497ce-ef67-473c-b2bb-9dd239d65f5e req-3da07dba-2e94-4d11-a700-fc1e8f57dae7 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Unset dirty status for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:53:45.382694 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d8497ce-ef67-473c-b2bb-9dd239d65f5e req-3da07dba-2e94-4d11-a700-fc1e8f57dae7 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 944 time: 0.5748134 Nov 11 11:53:45.466209 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7d8497ce-ef67-473c-b2bb-9dd239d65f5e req-7fc6faad-f5e6-42ee-bd4e-753e6493ebbb tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762396 Nov 11 11:53:45.467273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] For port e01bc857-5126-40f2-9281-d128a5805554, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:53:45.470570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] For port e01bc857-5126-40f2-9281-d128a5805554, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e01bc857-5126-40f2-9281-d128a5805554,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:53:45.508356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:45.513190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-14fc7b3d-14d6-4e6a-8a37-7f8aa6092fcf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:45.572282 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:45.574017 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] 10.222.0.60 "PUT /v2.0/ports/e01bc857-5126-40f2-9281-d128a5805554 HTTP/1.1" status: 200 len: 1094 time: 1.3892992 Nov 11 11:53:45.576488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd260e304-bbe8-4108-bfb9-938ad2f6d146', 'tag': 'e01bc857-5126-40f2-9281-d128a5805554'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:45.602603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Pushing event updated for resources: {'Port': ['ID=e01bc857-5126-40f2-9281-d128a5805554,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:45.605942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:45.672343 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd260e304-bbe8-4108-bfb9-938ad2f6d146', 'tag': 'e01bc857-5126-40f2-9281-d128a5805554', 'status': 'completed', 'code': 200} Nov 11 11:53:45.714853 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-5e7e371d-d226-446e-91dd-98ce0740b714 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 1097 time: 0.0778048 Nov 11 11:53:45.790857 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-b9758a33-06f9-4a99-b002-724ce41bb5b1 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e01bc857-5126-40f2-9281-d128a5805554 HTTP/1.1" status: 200 len: 217 time: 0.0677557 Nov 11 11:53:45.858694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a67b5d55-8164-411f-8887-f59016e3d880 req-2d95afdb-a256-4445-8699-95278ace90f1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:45.860262 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-2d95afdb-a256-4445-8699-95278ace90f1 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 HTTP/1.1" status: 200 len: 854 time: 0.0631986 Nov 11 11:53:45.914780 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-a2b348cb-b3b7-428f-9431-c14e2eb3d96b service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=b92aaf3b-0783-47c5-8158-f0c34b4d4466&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0465150 Nov 11 11:53:46.060082 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-34620d6a-71a2-4986-8b65-8b75a7462e72 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1382799 Nov 11 11:53:46.206191 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a67b5d55-8164-411f-8887-f59016e3d880 req-40b47d0e-db1f-4046-ac42-576c30064e21 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1393723 Nov 11 11:53:46.370233 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-29473499-b911-40dc-9407-f13c7d4ebdec req-bf00e512-06d6-4ac1-82b0-5210bebeda77 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 1097 time: 0.0736499 Nov 11 11:53:46.520441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29473499-b911-40dc-9407-f13c7d4ebdec req-571ad048-9cc4-4b7d-9875-a46bb1bd3978 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:46.522087 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-29473499-b911-40dc-9407-f13c7d4ebdec req-571ad048-9cc4-4b7d-9875-a46bb1bd3978 service neutron] 10.222.0.60 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 916 time: 0.1408565 Nov 11 11:53:46.632082 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-29473499-b911-40dc-9407-f13c7d4ebdec req-9147d99b-43f4-42e4-8a8c-0cbeabae5694 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e01bc857-5126-40f2-9281-d128a5805554 HTTP/1.1" status: 200 len: 217 time: 0.1024168 Nov 11 11:53:46.717685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29473499-b911-40dc-9407-f13c7d4ebdec req-2d02053d-e3a2-4158-82db-28b010738bbe service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:46.719283 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-29473499-b911-40dc-9407-f13c7d4ebdec req-2d02053d-e3a2-4158-82db-28b010738bbe service neutron] 10.222.0.60 "GET /v2.0/subnets?id=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 HTTP/1.1" status: 200 len: 854 time: 0.0764256 Nov 11 11:53:46.778047 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-29473499-b911-40dc-9407-f13c7d4ebdec req-0ac7cc93-5082-4960-bf81-ba6c6868a51d service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=b92aaf3b-0783-47c5-8158-f0c34b4d4466&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0497813 Nov 11 11:53:46.785428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ed9deb-a71c-410f-8b3c-697893b0cf39 req-3946581c-518b-4138-93c9-367bb0bcc3ac tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:46.787111 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e4ed9deb-a71c-410f-8b3c-697893b0cf39 req-3946581c-518b-4138-93c9-367bb0bcc3ac tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 944 time: 0.1903028 Nov 11 11:53:46.944075 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e4ed9deb-a71c-410f-8b3c-697893b0cf39 req-4b2652fd-0ebe-4fb2-b55b-df7b13c25eeb tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1287777 Nov 11 11:53:46.967787 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-29473499-b911-40dc-9407-f13c7d4ebdec req-f7076f23-3509-420f-93fa-c8d246e29fc7 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1769204 Nov 11 11:53:47.112195 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-29473499-b911-40dc-9407-f13c7d4ebdec req-0284aa93-975f-4709-8c9d-e29a03d7372d service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1376138 Nov 11 11:53:48.154688 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea25b4b-c45d-477a-a929-e9ed82688c2c req-def39141-61b3-4b83-a9f4-3d21ef712968 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:48.156341 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5ea25b4b-c45d-477a-a929-e9ed82688c2c req-def39141-61b3-4b83-a9f4-3d21ef712968 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 944 time: 0.0816505 Nov 11 11:53:48.209561 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5ea25b4b-c45d-477a-a929-e9ed82688c2c req-89f38213-9d05-4647-a1f3-484649e19ec8 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470536 Nov 11 11:53:49.421926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025c7021-730d-4db4-91dd-59ae77fdcfd2 req-f1c63f50-563e-43bb-bfc4-ba0c6f2e102d tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:49.423617 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-025c7021-730d-4db4-91dd-59ae77fdcfd2 req-f1c63f50-563e-43bb-bfc4-ba0c6f2e102d tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 944 time: 0.0909922 Nov 11 11:53:49.472640 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-025c7021-730d-4db4-91dd-59ae77fdcfd2 req-11a6cb71-ccf7-4342-b6a3-8ffc510ec7e3 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426199 Nov 11 11:53:50.682037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c4faec1-52c4-4f6f-8605-65ab455f8604 req-8a99411c-9331-404c-b62a-f82ed56919c6 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:50.683641 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4c4faec1-52c4-4f6f-8605-65ab455f8604 req-8a99411c-9331-404c-b62a-f82ed56919c6 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 944 time: 0.0853148 Nov 11 11:53:50.732357 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4c4faec1-52c4-4f6f-8605-65ab455f8604 req-0a364f3e-1c2f-4e71-a60e-400abeb2a082 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425174 Nov 11 11:53:50.808831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device e01bc857-5126-40f2-9281-d128a5805554 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:53:50.953742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port e01bc857-5126-40f2-9281-d128a5805554, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e01bc857-5126-40f2-9281-d128a5805554,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:50.968429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': 'e01bc857-5126-40f2-9281-d128a5805554', 'network_id': 'b92aaf3b-0783-47c5-8158-f0c34b4d4466', 'port_id': 'e01bc857-5126-40f2-9281-d128a5805554', 'mac_address': 'fa:16:3e:6c:ea:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1024, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:53:51.024104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:51.042315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e01bc857-5126-40f2-9281-d128a5805554 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:53:51.057223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port e01bc857-5126-40f2-9281-d128a5805554, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e01bc857-5126-40f2-9281-d128a5805554,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:51.085545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:51.087936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:51.155066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=e01bc857-5126-40f2-9281-d128a5805554,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:51.158228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:51.471574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['e01bc857-5126-40f2-9281-d128a5805554'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:53:51.940057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1b8fd7-162e-464c-a7e5-6117954fd25c req-392eecd6-c8f4-4a68-851c-16bcd4bba7d7 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:51.941662 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-df1b8fd7-162e-464c-a7e5-6117954fd25c req-392eecd6-c8f4-4a68-851c-16bcd4bba7d7 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 945 time: 0.0828054 Nov 11 11:53:51.990483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-df1b8fd7-162e-464c-a7e5-6117954fd25c req-16e3f10a-847f-44b3-9d55-204395ac5058 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424616 Nov 11 11:53:52.840738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device e01bc857-5126-40f2-9281-d128a5805554 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:53:52.972090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port e01bc857-5126-40f2-9281-d128a5805554 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:53:52.977428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port e01bc857-5126-40f2-9281-d128a5805554 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:53:52.977965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:53.105074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:53.132621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd260e304-bbe8-4108-bfb9-938ad2f6d146', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e01bc857-5126-40f2-9281-d128a5805554'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:53:53.142550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port e01bc857-5126-40f2-9281-d128a5805554, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e01bc857-5126-40f2-9281-d128a5805554,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:53:53.172403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:53:53.174502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:53:53.205127 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd260e304-bbe8-4108-bfb9-938ad2f6d146', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e01bc857-5126-40f2-9281-d128a5805554', 'code': 200} Nov 11 11:53:53.210885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17188f3-ef07-4b9a-aaaa-3e2fe35ad8c4 req-eef58be7-82e8-488e-acb4-8350062e6ade tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:53.212623 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b17188f3-ef07-4b9a-aaaa-3e2fe35ad8c4 req-eef58be7-82e8-488e-acb4-8350062e6ade tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 946 time: 0.0940192 Nov 11 11:53:53.244491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=e01bc857-5126-40f2-9281-d128a5805554,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:53:53.247584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:53:53.266792 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b17188f3-ef07-4b9a-aaaa-3e2fe35ad8c4 req-91de1cba-29bb-41b8-8091-03e6b67dbea7 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461981 Nov 11 11:53:53.483547 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b94b8b4e-0df5-448a-9306-5bc64eae23c4 req-d47be711-5ff1-4c2c-a3d8-1be915509a71 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 1099 time: 0.0732512 Nov 11 11:53:53.534092 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b94b8b4e-0df5-448a-9306-5bc64eae23c4 req-981098b8-d560-487b-bb69-e21e25721cd2 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438244 Nov 11 11:53:54.475583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed33e223-7203-4bd8-93f5-63087e53f755 req-d7abbf65-9f4e-4c7b-9511-4333961596ab tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:54.477198 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed33e223-7203-4bd8-93f5-63087e53f755 req-d7abbf65-9f4e-4c7b-9511-4333961596ab tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 946 time: 0.0844228 Nov 11 11:53:54.527846 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ed33e223-7203-4bd8-93f5-63087e53f755 req-0a9b9b71-df17-483e-9add-c1430835ff6c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436320 Nov 11 11:53:55.739655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3c9260d-9ffa-4075-84d7-5644bff3c6a2 req-034d19af-4c57-4fa0-8e1d-ca962d442117 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:53:55.741245 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b3c9260d-9ffa-4075-84d7-5644bff3c6a2 req-034d19af-4c57-4fa0-8e1d-ca962d442117 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 946 time: 0.0875702 Nov 11 11:53:55.789618 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b3c9260d-9ffa-4075-84d7-5644bff3c6a2 req-0057f993-6dd0-4a68-b65a-4a6c6aa2c959 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415545 Nov 11 11:54:04.752180 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:09.834211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501021cf-50e3-4241-b2bd-c6fc97c3b104 req-6ec16f63-e0b5-43b6-a082-43f6005d1dc0 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:09.835768 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-501021cf-50e3-4241-b2bd-c6fc97c3b104 req-6ec16f63-e0b5-43b6-a082-43f6005d1dc0 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 946 time: 0.0848329 Nov 11 11:54:09.885581 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-501021cf-50e3-4241-b2bd-c6fc97c3b104 req-582d9377-3aaf-4ba6-9b39-7ccb4f4d0447 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434985 Nov 11 11:54:10.011416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5355182d-bc58-4571-b73d-82cff88cccb9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:11.105880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3b33528-1252-44be-ab79-4e3f063ad613 req-ec99383a-8bfe-43d2-8284-d663052c95d4 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:11.107478 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3b33528-1252-44be-ab79-4e3f063ad613 req-ec99383a-8bfe-43d2-8284-d663052c95d4 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 946 time: 0.0874271 Nov 11 11:54:11.157012 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3b33528-1252-44be-ab79-4e3f063ad613 req-a8714989-dbe2-43ba-a0b0-5cc6b2466600 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426977 Nov 11 11:54:11.274504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:11.834407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-2e21d317-0596-4244-9090-8e951dce6e1f tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:11.836751 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-2e21d317-0596-4244-9090-8e951dce6e1f tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 946 time: 0.1007109 Nov 11 11:54:11.919584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Deleting port e01bc857-5126-40f2-9281-d128a5805554 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:54:11.919965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:12.191344 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] For port e01bc857-5126-40f2-9281-d128a5805554, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=e01bc857-5126-40f2-9281-d128a5805554,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:54:12.191913 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:12.327422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Calling delete_port for e01bc857-5126-40f2-9281-d128a5805554 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:54:12.494791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc97f4c-9d9f-4760-bea2-be556893d249 req-0ca0b834-eef6-4e4c-9822-bb1d0419b491 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:12.497200 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2cc97f4c-9d9f-4760-bea2-be556893d249 req-0ca0b834-eef6-4e4c-9822-bb1d0419b491 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 946 time: 0.1766510 Nov 11 11:54:12.601485 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2cc97f4c-9d9f-4760-bea2-be556893d249 req-32205f5e-d9f4-4dc6-8237-63d2f9943ce3 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0978677 Nov 11 11:54:12.680972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:12.687245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4f6faec2-26f9-4f35-9ae0-57a50b2632e1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:12.693266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['52672ac7-2b99-4bcd-8a42-9c6e53617d59', '80f4cc1c-ab72-48bf-8095-c5835e08bfc3', 'd9832190-38d9-40fb-b1b9-f953eebfb4b8', 'e01bc857-5126-40f2-9281-d128a5805554'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:54:12.731971 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Pushing event deleted for resources: {'Port': ['ID=e01bc857-5126-40f2-9281-d128a5805554,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:12.781264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.781685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.782104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.782507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.782908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.783346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.783745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.784139 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.784532 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.784922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.785312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:12.792968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:12.833037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] No DVR routers for this DVR port e01bc857-5126-40f2-9281-d128a5805554 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:54:12.836016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:12.839403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd260e304-bbe8-4108-bfb9-938ad2f6d146', 'name': 'network-vif-deleted', 'tag': 'e01bc857-5126-40f2-9281-d128a5805554'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:54:12.881671 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-99d88e0c-c3f9-4a72-a5af-7256b2aa635a req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "DELETE /v2.0/ports/e01bc857-5126-40f2-9281-d128a5805554 HTTP/1.1" status: 204 len: 173 time: 1.0391510 Nov 11 11:54:12.897169 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd260e304-bbe8-4108-bfb9-938ad2f6d146', 'name': 'network-vif-deleted', 'tag': 'e01bc857-5126-40f2-9281-d128a5805554', 'status': 'completed', 'code': 200} Nov 11 11:54:13.480865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9d42478-481f-4cac-bd86-bb11e51d7a96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:13.521014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:13.791124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-a393bba8-6a3d-42e6-b341-cf8f4e897606 req-9caeaec7-428b-4750-b12c-50289b424581 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Synchronizing usage tracker for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:54:13.830171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-a393bba8-6a3d-42e6-b341-cf8f4e897606 req-9caeaec7-428b-4750-b12c-50289b424581 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Unset dirty status for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:54:13.831217 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a393bba8-6a3d-42e6-b341-cf8f4e897606 req-9caeaec7-428b-4750-b12c-50289b424581 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d260e304-bbe8-4108-bfb9-938ad2f6d146 HTTP/1.1" status: 200 len: 210 time: 0.0873859 Nov 11 11:54:14.613584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:54:14.675263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:14.961496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device e01bc857-5126-40f2-9281-d128a5805554 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:54:14.996901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: e01bc857-5126-40f2-9281-d128a5805554 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:54:14.997304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device e01bc857-5126-40f2-9281-d128a5805554 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:54:16.993535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c66ce40-1501-4cb6-9eaa-5c0c9f045a95 req-deee5605-6606-49bc-af77-190252fc5e96 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:16.995134 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0c66ce40-1501-4cb6-9eaa-5c0c9f045a95 req-deee5605-6606-49bc-af77-190252fc5e96 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 946 time: 0.3027930 Nov 11 11:54:17.044652 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0c66ce40-1501-4cb6-9eaa-5c0c9f045a95 req-dabef2a7-dc19-4187-93c5-7b91ba6803f3 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425971 Nov 11 11:54:18.256372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d4f812-9f80-4715-9af1-d81424f609a6 req-ce9f0930-20f8-4a29-90e0-b04312ed1cda tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:18.258231 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d7d4f812-9f80-4715-9af1-d81424f609a6 req-ce9f0930-20f8-4a29-90e0-b04312ed1cda tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 946 time: 0.0872607 Nov 11 11:54:18.307082 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d7d4f812-9f80-4715-9af1-d81424f609a6 req-b5ef8b90-3eec-4cee-beee-677b8723bd4c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426848 Nov 11 11:54:18.724774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-4752be93-91d0-4526-ade2-4da628ab6a58 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:18.726347 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-4752be93-91d0-4526-ade2-4da628ab6a58 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 946 time: 0.0832937 Nov 11 11:54:18.798573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Deleting port d9832190-38d9-40fb-b1b9-f953eebfb4b8 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:54:18.798953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:19.051348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] For port d9832190-38d9-40fb-b1b9-f953eebfb4b8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=d9832190-38d9-40fb-b1b9-f953eebfb4b8,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:54:19.051994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:19.183507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Calling delete_port for d9832190-38d9-40fb-b1b9-f953eebfb4b8 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:54:19.475484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:19.484891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-188430e2-4b6a-4f3d-9964-3fdf11b2ac38 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:19.487398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['52672ac7-2b99-4bcd-8a42-9c6e53617d59', '80f4cc1c-ab72-48bf-8095-c5835e08bfc3', 'd9832190-38d9-40fb-b1b9-f953eebfb4b8'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:54:19.520347 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-30671e69-b37e-4ebc-9498-f11c30c619a0 req-98568bec-30b6-49bd-b3b5-3e0e2b1df32c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=c611a479-1519-4b89-822b-fd2ba5ed559e HTTP/1.1" status: 200 len: 210 time: 0.0836980 Nov 11 11:54:19.548918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Pushing event deleted for resources: {'Port': ['ID=d9832190-38d9-40fb-b1b9-f953eebfb4b8,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:19.549428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:19.620736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] No DVR routers for this DVR port d9832190-38d9-40fb-b1b9-f953eebfb4b8 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:54:19.623263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:19.626772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c611a479-1519-4b89-822b-fd2ba5ed559e', 'name': 'network-vif-deleted', 'tag': 'd9832190-38d9-40fb-b1b9-f953eebfb4b8'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:54:19.672096 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f00ecfc6-24f8-4b08-8184-a8b12f76e6e2 req-f08fbf68-a4db-4b95-bba4-4ce715cf3605 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "DELETE /v2.0/ports/d9832190-38d9-40fb-b1b9-f953eebfb4b8 HTTP/1.1" status: 204 len: 173 time: 0.9401512 Nov 11 11:54:19.683861 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c611a479-1519-4b89-822b-fd2ba5ed559e', 'name': 'network-vif-deleted', 'tag': 'd9832190-38d9-40fb-b1b9-f953eebfb4b8', 'status': 'completed', 'code': 200} Nov 11 11:54:20.934987 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-1b89f5be-b9aa-49a4-863b-ddc51ad940e1 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0869517 Nov 11 11:54:21.173335 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-ddb1c8ca-c378-4ee6-bbb8-c987cc390733 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=9c2955dc91344feaaa33bc192608a822&device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 1098 time: 0.1587884 Nov 11 11:54:21.179432 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be30a4e6-dcd0-4d1d-b1f3-b86e11c40a64 req-2aa5893c-9aad-4acd-b0be-4f7631a719ec tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:21.180160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-be30a4e6-dcd0-4d1d-b1f3-b86e11c40a64 req-2aa5893c-9aad-4acd-b0be-4f7631a719ec tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Synchronizing usage tracker for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:54:21.236922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-be30a4e6-dcd0-4d1d-b1f3-b86e11c40a64 req-2aa5893c-9aad-4acd-b0be-4f7631a719ec tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Unset dirty status for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:54:21.238166 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-be30a4e6-dcd0-4d1d-b1f3-b86e11c40a64 req-2aa5893c-9aad-4acd-b0be-4f7631a719ec tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.1823721 Nov 11 11:54:21.366366 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-be30a4e6-dcd0-4d1d-b1f3-b86e11c40a64 req-003f021c-9a3c-42dd-aeff-67b14e239df2 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804939 Nov 11 11:54:21.367550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-0b94cd80-80de-4e58-b6d8-a463a4f23f60 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:21.369080 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-0b94cd80-80de-4e58-b6d8-a463a4f23f60 service neutron] 10.222.0.60 "GET /v2.0/networks?id=b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 200 len: 916 time: 0.1765318 Nov 11 11:54:21.445404 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-c2f553e9-bd90-4c33-b6b7-dd5e99087729 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=52672ac7-2b99-4bcd-8a42-9c6e53617d59 HTTP/1.1" status: 200 len: 217 time: 0.0688317 Nov 11 11:54:21.515344 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-8c6511ca-9fe8-4cc8-b154-e44af2f8771b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:21.516860 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-8c6511ca-9fe8-4cc8-b154-e44af2f8771b service neutron] 10.222.0.60 "GET /v2.0/subnets?id=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 HTTP/1.1" status: 200 len: 854 time: 0.0648632 Nov 11 11:54:21.571251 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-26bf65a5-8a7f-4226-b108-9335d392a70e service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=b92aaf3b-0783-47c5-8158-f0c34b4d4466&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0467741 Nov 11 11:54:21.713011 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-f06f67c7-fe93-48a6-93cb-a6ad06caedce service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1347251 Nov 11 11:54:21.852992 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a411fdf2-7f13-4697-89b2-70ddc31f9fd6 req-68a24247-a8a5-49d7-b048-bfeebb2a1ac5 service neutron] 10.222.0.60 "GET /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1328528 Nov 11 11:54:22.581820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce337144-d7ff-4642-8d99-d63cd770f170 req-4b9fec58-30a8-40a3-85d6-439327959d24 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:22.583458 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ce337144-d7ff-4642-8d99-d63cd770f170 req-4b9fec58-30a8-40a3-85d6-439327959d24 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.0837610 Nov 11 11:54:22.631790 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ce337144-d7ff-4642-8d99-d63cd770f170 req-ad2cf42b-6d46-4909-bb36-8f078481047c tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419290 Nov 11 11:54:22.797990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-6650fcb0-27ff-4d2d-9157-a773167b5ac9 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:22.800224 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-6650fcb0-27ff-4d2d-9157-a773167b5ac9 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 945 time: 0.0887666 Nov 11 11:54:22.872878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Deleting port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:54:22.873269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:23.026373 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device d9832190-38d9-40fb-b1b9-f953eebfb4b8 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:54:23.062218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: d9832190-38d9-40fb-b1b9-f953eebfb4b8 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:54:23.062618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device d9832190-38d9-40fb-b1b9-f953eebfb4b8 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:54:23.129766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] For port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:54:23.130157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:23.259303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Calling delete_port for 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:54:23.443121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:23.449181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-734f8a96-7c7a-4fc6-8829-4152ae7ecd1e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:23.455115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['52672ac7-2b99-4bcd-8a42-9c6e53617d59', '80f4cc1c-ab72-48bf-8095-c5835e08bfc3'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:54:23.491089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Pushing event deleted for resources: {'Port': ['ID=80f4cc1c-ab72-48bf-8095-c5835e08bfc3,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:23.495717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:23.574972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] No DVR routers for this DVR port 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:54:23.578003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:23.580558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '81029bd7-a808-496c-abad-87f226dd07c5', 'name': 'network-vif-deleted', 'tag': '80f4cc1c-ab72-48bf-8095-c5835e08bfc3'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:54:23.616769 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-32e5f779-4c63-4545-8357-fc93829f7f09 req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "DELETE /v2.0/ports/80f4cc1c-ab72-48bf-8095-c5835e08bfc3 HTTP/1.1" status: 204 len: 173 time: 0.8109393 Nov 11 11:54:23.642215 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '81029bd7-a808-496c-abad-87f226dd07c5', 'name': 'network-vif-deleted', 'tag': '80f4cc1c-ab72-48bf-8095-c5835e08bfc3', 'status': 'completed', 'code': 200} Nov 11 11:54:23.808168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-9390f0a7-c4ca-45cd-bfb6-47550a269808 req-82b4e46d-d198-4309-8005-6df75606c785 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Synchronizing usage tracker for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:54:23.860582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-9390f0a7-c4ca-45cd-bfb6-47550a269808 req-82b4e46d-d198-4309-8005-6df75606c785 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Unset dirty status for tenant:9c2955dc91344feaaa33bc192608a822 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:54:23.862530 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9390f0a7-c4ca-45cd-bfb6-47550a269808 req-82b4e46d-d198-4309-8005-6df75606c785 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=81029bd7-a808-496c-abad-87f226dd07c5 HTTP/1.1" status: 200 len: 210 time: 0.1022315 Nov 11 11:54:26.886614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9e8fa5-0c28-49fc-b2c9-fabacd454187 req-2e6a2c6a-164c-40d4-bb3a-f0b45df2ada1 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:26.888280 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd9e8fa5-0c28-49fc-b2c9-fabacd454187 req-2e6a2c6a-164c-40d4-bb3a-f0b45df2ada1 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 945 time: 0.0841594 Nov 11 11:54:26.940688 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd9e8fa5-0c28-49fc-b2c9-fabacd454187 req-5bfe255f-461a-472a-bcf5-cc36f617f0a1 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455599 Nov 11 11:54:27.057911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:54:27.092301 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:54:27.092695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 80f4cc1c-ab72-48bf-8095-c5835e08bfc3 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:54:28.149387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eef018b1-587a-48a5-bb6a-c6b3a6a0569c req-dfda4fe9-51ff-425b-91e7-74472cc43550 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:28.151267 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eef018b1-587a-48a5-bb6a-c6b3a6a0569c req-dfda4fe9-51ff-425b-91e7-74472cc43550 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 945 time: 0.0814147 Nov 11 11:54:28.204111 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-eef018b1-587a-48a5-bb6a-c6b3a6a0569c req-67f5a185-bd8c-4862-8548-2d10820223e9 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/security-groups?id=18a87f4b-de66-4ce5-b408-48f15635a0bb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464721 Nov 11 11:54:28.695753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-ece53602-830c-48ac-88fe-ffcf4d193be4 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:28.697305 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-ece53602-830c-48ac-88fe-ffcf4d193be4 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 945 time: 0.0849106 Nov 11 11:54:28.771171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Deleting port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:54:28.771395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:29.027457 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] For port 52672ac7-2b99-4bcd-8a42-9c6e53617d59, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=52672ac7-2b99-4bcd-8a42-9c6e53617d59,segment=NetworkSegment(48b3fee6-4c38-4975-aea7-8c618366f035),segment_id=48b3fee6-4c38-4975-aea7-8c618366f035)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:54:29.027861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:29.178368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Calling delete_port for 52672ac7-2b99-4bcd-8a42-9c6e53617d59 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:54:29.366501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:29.377769 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9c42c10a-d10b-49e2-93f5-78f4aa3440cd tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:29.377928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['52672ac7-2b99-4bcd-8a42-9c6e53617d59'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:54:29.415246 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-dae69b16-aa09-4bf5-8072-ed0d91788907 req-2af101ad-279e-4579-ad1b-065774d80a04 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.11 "GET /v2.0/ports?device_id=4dac1f21-d5f2-44cf-823e-5ed387668e02 HTTP/1.1" status: 200 len: 210 time: 0.0878713 Nov 11 11:54:29.426705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Pushing event deleted for resources: {'Port': ['ID=52672ac7-2b99-4bcd-8a42-9c6e53617d59,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:29.429285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:29.712204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] No DVR routers for this DVR port 52672ac7-2b99-4bcd-8a42-9c6e53617d59 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:54:29.714692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:29.718921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4dac1f21-d5f2-44cf-823e-5ed387668e02', 'name': 'network-vif-deleted', 'tag': '52672ac7-2b99-4bcd-8a42-9c6e53617d59'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:54:29.776423 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4dac1f21-d5f2-44cf-823e-5ed387668e02', 'name': 'network-vif-deleted', 'tag': '52672ac7-2b99-4bcd-8a42-9c6e53617d59', 'status': 'completed', 'code': 200} Nov 11 11:54:29.778002 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-369b0d6b-c388-408f-a50c-48aefe1122fc req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] 10.222.0.60 "DELETE /v2.0/ports/52672ac7-2b99-4bcd-8a42-9c6e53617d59 HTTP/1.1" status: 204 len: 173 time: 1.0756068 Nov 11 11:54:30.526767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41008) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:30.597933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] Deleting subnet 52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 {{(pid=88329) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:54:30.601042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:30.654649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852055773'] for subnet, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:30.711113 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:30.828193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852055754', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036852017038'] for subnet, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:30.833718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ed5768c1-03f0-4a22-aa85-0f94dc9428d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:30.873673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:30.876541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:30.880220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:30.886689 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c5352fdf-1202-4b72-841b-cbf92babfb4c admin admin] 10.222.0.11 "DELETE /v2.0/subnets/52fc6bb0-6f7a-4f6f-8e6c-1198cb5f7266 HTTP/1.1" status: 204 len: 168 time: 0.3579974 Nov 11 11:54:30.889491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41012) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:31.005232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:31.142214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:31.168709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b92aaf3b-0783-47c5-8158-f0c34b4d4466']}} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:54:31.184952 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '48b3fee6-4c38-4975-aea7-8c618366f035') {'for_net_delete': True} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:54:31.185289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '48b3fee6-4c38-4975-aea7-8c618366f035') {} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:54:31.198196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2720042'] for segment, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:31.213851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:31.220406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Releasing vlan 1024 on physical network physnet1 to pool {{(pid=88329) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:54:31.220836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2720660'] for segment, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:54:31.234715 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:54:31.365198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:31.369074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-004a0453-7d27-4769-993a-1dd01a8e4147 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:31.386045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:31.393018 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Pushing event deleted for resources: {'Network': ['ID=b92aaf3b-0783-47c5-8158-f0c34b4d4466,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:31.396805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:31.398727 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-eb8d1317-ca0a-4a3c-b8bc-fcbd739fabaa admin admin] 10.222.0.11 "DELETE /v2.0/networks/b92aaf3b-0783-47c5-8158-f0c34b4d4466 HTTP/1.1" status: 204 len: 168 time: 0.5082090 Nov 11 11:54:31.830385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41018) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:31.883855 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-502bdeb3-1e17-4e7f-a71a-e409bbae3c35 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9c2955dc91344feaaa33bc192608a822&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0521801 Nov 11 11:54:31.886749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41022) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:31.949391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e50bea5e-f96b-470b-afb2-3cbcc8fda046 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:31.981213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e50bea5e-f96b-470b-afb2-3cbcc8fda046 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:32.056793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e50bea5e-f96b-470b-afb2-3cbcc8fda046 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:32.061910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cb7c8725-ef45-4080-8849-8514b18419bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:32.074896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50bea5e-f96b-470b-afb2-3cbcc8fda046 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18a87f4b-de66-4ce5-b408-48f15635a0bb,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:32.077591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e50bea5e-f96b-470b-afb2-3cbcc8fda046 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:32.081529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e50bea5e-f96b-470b-afb2-3cbcc8fda046 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:32.083679 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-e50bea5e-f96b-470b-afb2-3cbcc8fda046 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/18a87f4b-de66-4ce5-b408-48f15635a0bb HTTP/1.1" status: 204 len: 168 time: 0.1955678 Nov 11 11:54:33.092346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 52672ac7-2b99-4bcd-8a42-9c6e53617d59 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:54:33.131437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 52672ac7-2b99-4bcd-8a42-9c6e53617d59 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:54:33.131833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 52672ac7-2b99-4bcd-8a42-9c6e53617d59 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:54:34.862983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:35.732213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41090) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:35.889504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:35.923101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:54:35.927207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Usage tracker for resource:security_group_rule and tenant:aa4911375abc4565a3d369f8c74889ab is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:54:35.930159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:54:35.936200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:54:36.003424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:36.028626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:36.037084 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b17ca986-6a9f-4d73-8cec-2aca32c9d06b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:36.080885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9686075-6cd9-4c0e-b7bc-88303742f93c,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:36.084773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:36.087856 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-8198d898-dc80-4d5b-b4e1-2fa853a5ffa9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=aa4911375abc4565a3d369f8c74889ab&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3545032 Nov 11 11:54:36.091061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41096) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:36.159925 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:36.187506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:36.325881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:36.331289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-42bf5c6e-3893-4ed4-a49b-1b19392833d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:36.343116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9686075-6cd9-4c0e-b7bc-88303742f93c,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:36.354718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:36.355978 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c9686075-6cd9-4c0e-b7bc-88303742f93c HTTP/1.1" status: 204 len: 168 time: 0.2638140 Nov 11 11:54:36.357935 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.358592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.358790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.359173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.359599 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.360014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.360558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.360968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.361379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.361844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.362164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:54:36.365417 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f59a2d78-1fe8-48df-b0c4-d39e7831c1bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:36.853835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41104) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:36.875640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:36.908205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:54:36.912210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Usage tracker for resource:security_group_rule and tenant:bd955d92407f4a41b76e900dd8fd4d2a is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:54:36.915140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:54:36.921064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:54:36.987756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:37.023448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:37.031352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8e6e0ea2-8419-46d7-9e16-29f0d55f298e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:37.077798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20841f89-d0ea-4a73-aecf-e35edcfbc708,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:37.081971 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bd955d92407f4a41b76e900dd8fd4d2a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2270494 Nov 11 11:54:37.082974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:37.084847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41108) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:37.150377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d0708bdb-fb0d-40eb-9db2-eb9bc0ab241d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:37.179835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d0708bdb-fb0d-40eb-9db2-eb9bc0ab241d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:37.383660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d0708bdb-fb0d-40eb-9db2-eb9bc0ab241d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:37.388136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4e1f786c-2ded-4661-b9ec-e2363286e441 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:37.400540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0708bdb-fb0d-40eb-9db2-eb9bc0ab241d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20841f89-d0ea-4a73-aecf-e35edcfbc708,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:37.402886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d0708bdb-fb0d-40eb-9db2-eb9bc0ab241d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:37.408545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d0708bdb-fb0d-40eb-9db2-eb9bc0ab241d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:37.409780 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d0708bdb-fb0d-40eb-9db2-eb9bc0ab241d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/20841f89-d0ea-4a73-aecf-e35edcfbc708 HTTP/1.1" status: 204 len: 168 time: 0.3239176 Nov 11 11:54:40.018441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bf70ad8d-69ec-4696-ab42-354990234cfa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:41.264933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:43.476966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1b1b1348-f769-483e-a1bc-643822e10b6e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:43.516493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:44.694119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:46.576675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806344a3-7dcf-4b03-81d5-fe74f4b0c1dd req-f3b3579b-4e78-4b69-af49-169cdd22f91e tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:46.578308 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-806344a3-7dcf-4b03-81d5-fe74f4b0c1dd req-f3b3579b-4e78-4b69-af49-169cdd22f91e tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.1606631 Nov 11 11:54:46.581550 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-cb680128-97ec-48f8-8700-a8240a3db458 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1138 time: 0.1192265 Nov 11 11:54:46.737844 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-806344a3-7dcf-4b03-81d5-fe74f4b0c1dd req-bd863b83-196f-4262-95c4-0b3457f996dd tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1527379 Nov 11 11:54:46.774895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-2267bf23-de6b-4416-8407-bfcea8f7d308 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:46.776603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-2267bf23-de6b-4416-8407-bfcea8f7d308 service neutron] 10.222.0.60 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 917 time: 0.1740618 Nov 11 11:54:46.892224 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-181a08f0-060d-4820-aab7-2e9ae0a856bf service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 1002 time: 0.1085987 Nov 11 11:54:46.968781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-c2c2af01-cb31-4e45-815b-94c077771f10 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:46.970508 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-c2c2af01-cb31-4e45-815b-94c077771f10 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 200 len: 854 time: 0.0712087 Nov 11 11:54:47.061271 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-f71602b7-62c5-4b7c-90d3-6aa24d2986cc service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0832801 Nov 11 11:54:47.214754 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-7a9fdf5d-a616-4a1d-8e0f-4ba9864de5fd service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1456361 Nov 11 11:54:47.359557 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a665e2b1-d73c-4e7b-b9ac-fe2b444cb62f req-35476153-43f1-42fe-b672-55636eae18f6 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1378555 Nov 11 11:54:48.019740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0505cb53-48b9-472f-a4ad-a07f14c441dd req-6093b8ce-ef37-4e92-a96f-424e694e4032 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:48.021398 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0505cb53-48b9-472f-a4ad-a07f14c441dd req-6093b8ce-ef37-4e92-a96f-424e694e4032 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0893745 Nov 11 11:54:48.074245 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0505cb53-48b9-472f-a4ad-a07f14c441dd req-4541debd-1d0f-4b8c-a50b-959dd860ac63 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0457158 Nov 11 11:54:49.286644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccd39454-ca07-4cdd-b55b-7091a9c9edcc req-bfe6fa77-7804-4975-94c3-7d5b64c8fc40 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:49.288312 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ccd39454-ca07-4cdd-b55b-7091a9c9edcc req-bfe6fa77-7804-4975-94c3-7d5b64c8fc40 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0888531 Nov 11 11:54:49.341551 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ccd39454-ca07-4cdd-b55b-7091a9c9edcc req-35a1e10e-f613-45fb-b722-a3d92b871519 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0464423 Nov 11 11:54:50.556438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a47c608-2bda-4562-a5d4-56c74b7d3f6d req-57edd83a-718f-4b40-abbc-80d1bdd32749 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:50.558064 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9a47c608-2bda-4562-a5d4-56c74b7d3f6d req-57edd83a-718f-4b40-abbc-80d1bdd32749 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0897472 Nov 11 11:54:50.620256 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9a47c608-2bda-4562-a5d4-56c74b7d3f6d req-d9743503-4cb7-4fde-b3ba-83cf5ebe3a16 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0539277 Nov 11 11:54:51.615927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:54:51.847224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1f6007-84d7-4b39-bcf7-9ca2ed8b5993 req-c7133dae-3392-4401-bd95-14e5ba200eda tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:51.848833 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9a1f6007-84d7-4b39-bcf7-9ca2ed8b5993 req-c7133dae-3392-4401-bd95-14e5ba200eda tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0928867 Nov 11 11:54:51.906471 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9a1f6007-84d7-4b39-bcf7-9ca2ed8b5993 req-d42c4195-e5c2-42fe-aa4b-a23cfa8c347c tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0471125 Nov 11 11:54:53.132345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e364a51a-22a6-4fda-8d18-2555c8820da7 req-376788a5-44a2-4e46-901e-2277833d6673 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:53.132345 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e364a51a-22a6-4fda-8d18-2555c8820da7 req-376788a5-44a2-4e46-901e-2277833d6673 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0951502 Nov 11 11:54:53.184155 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e364a51a-22a6-4fda-8d18-2555c8820da7 req-479538d6-ce79-4d0e-9dfa-ffd6216e3fe5 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0463943 Nov 11 11:54:54.392226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a2ba73-79f6-4bbc-b5b0-55f316a56a83 req-d6aaf6f5-edba-4a99-8f4c-e8818c2e0cdd tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:54.393773 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d3a2ba73-79f6-4bbc-b5b0-55f316a56a83 req-d6aaf6f5-edba-4a99-8f4c-e8818c2e0cdd tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0843921 Nov 11 11:54:54.452878 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d3a2ba73-79f6-4bbc-b5b0-55f316a56a83 req-7e4cf806-f31d-4943-b776-9c0457541c0e tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0525525 Nov 11 11:54:55.666670 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15036ca0-af41-4d3f-b82d-471bb6f0d14d req-3930ba94-b73e-4cfc-9c7d-508fc71e907d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:55.671364 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-15036ca0-af41-4d3f-b82d-471bb6f0d14d req-3930ba94-b73e-4cfc-9c7d-508fc71e907d tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0848839 Nov 11 11:54:55.720046 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-15036ca0-af41-4d3f-b82d-471bb6f0d14d req-df766db4-1e3e-44b2-98c9-1fc02d6493e7 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0453510 Nov 11 11:54:56.931004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeda0916-ad57-4d54-8ace-b4b1deec8a38 req-0f0fc7ee-638b-4e86-9fce-b4dd6f98b012 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:56.933076 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aeda0916-ad57-4d54-8ace-b4b1deec8a38 req-0f0fc7ee-638b-4e86-9fce-b4dd6f98b012 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0880544 Nov 11 11:54:56.984126 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aeda0916-ad57-4d54-8ace-b4b1deec8a38 req-394b5b29-f8d6-41d8-a940-b8f5a95e6ddd tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0443919 Nov 11 11:54:58.166380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41346) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:58.192375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0624282-0025-45c8-877b-92dad84ba52d req-31afe32d-216a-4f25-96da-847c7a09f312 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:58.193984 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c0624282-0025-45c8-877b-92dad84ba52d req-31afe32d-216a-4f25-96da-847c7a09f312 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0843954 Nov 11 11:54:58.249760 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c0624282-0025-45c8-877b-92dad84ba52d req-f6ce1831-5f09-4ad5-aa3c-5440dda67a4f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0493977 Nov 11 11:54:58.331141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:58.364682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:54:58.368739 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Usage tracker for resource:security_group_rule and tenant:6e25c99aafd3469799347013a9889b90 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:54:58.372377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:54:58.378672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:54:58.511894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:58.544068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:58.552306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a78453ab-4b5e-4e75-a8e2-80282ba1920a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:58.600948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e8757f8-ac60-4d85-ab49-aec5c85b70f4,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:58.606838 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6e25c99aafd3469799347013a9889b90&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4392307 Nov 11 11:54:58.608086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-42611ec8-8c77-4526-a719-b0de0ce4e092 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:58.610032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41352) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:58.680013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0220768c-a518-45f1-a4d2-f19024a1fe0e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:58.706573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0220768c-a518-45f1-a4d2-f19024a1fe0e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:58.817037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0220768c-a518-45f1-a4d2-f19024a1fe0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:58.821177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3566c72f-ae23-45b3-b4cc-af6b805eb374 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:58.834461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0220768c-a518-45f1-a4d2-f19024a1fe0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e8757f8-ac60-4d85-ab49-aec5c85b70f4,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:58.837141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0220768c-a518-45f1-a4d2-f19024a1fe0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:58.843867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0220768c-a518-45f1-a4d2-f19024a1fe0e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:58.845464 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0220768c-a518-45f1-a4d2-f19024a1fe0e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/6e8757f8-ac60-4d85-ab49-aec5c85b70f4 HTTP/1.1" status: 204 len: 168 time: 0.2338581 Nov 11 11:54:59.287134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41362) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:59.310951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:59.344320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:54:59.348380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Usage tracker for resource:security_group_rule and tenant:de67e96b0a8f46d7baecd1118572ebde is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:54:59.351408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:54:59.357480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:54:59.435796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:59.468245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:59.469167 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3fe18e2-0eb6-446c-bf90-c14ee65b3793 req-f2d988fa-8179-4d96-a03f-48b5deb19ec0 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:54:59.470771 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b3fe18e2-0eb6-446c-bf90-c14ee65b3793 req-f2d988fa-8179-4d96-a03f-48b5deb19ec0 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.0885372 Nov 11 11:54:59.476177 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b6540a8b-96f8-4bd2-a117-fb29c1346474 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:59.519991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93729657-6447-4364-acfd-3eb09495fc19,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:59.522771 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b3fe18e2-0eb6-446c-bf90-c14ee65b3793 req-1bceaf2f-c8b4-4efd-87f2-89c8db99fca7 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=daef70c8-952a-438d-8bc5-0c7677b1fd83&id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0451419 Nov 11 11:54:59.526294 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:59.532896 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4e50391a-64ef-45d6-959a-69431d1f41da admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=de67e96b0a8f46d7baecd1118572ebde&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2445176 Nov 11 11:54:59.533081 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41366) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:54:59.597705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2d43cb1-9e38-4612-9a36-437f58e7f632 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:59.625679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2d43cb1-9e38-4612-9a36-437f58e7f632 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:59.696809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2d43cb1-9e38-4612-9a36-437f58e7f632 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:59.701767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-90e08eb6-0ea6-417a-bee0-784a0462e825 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:54:59.717140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d43cb1-9e38-4612-9a36-437f58e7f632 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93729657-6447-4364-acfd-3eb09495fc19,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:54:59.724766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c2d43cb1-9e38-4612-9a36-437f58e7f632 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:54:59.726962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c2d43cb1-9e38-4612-9a36-437f58e7f632 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:54:59.728219 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c2d43cb1-9e38-4612-9a36-437f58e7f632 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/93729657-6447-4364-acfd-3eb09495fc19 HTTP/1.1" status: 204 len: 168 time: 0.1942072 Nov 11 11:55:04.767044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:10.018671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-86eea6f4-ce0c-4d98-915a-d26e85971510 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:11.264704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:13.482830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6009f8e3-3fb2-4668-8d3b-3b1b3eb0f688 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:13.524011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:14.683072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:24.635479 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-372e10ea-7485-4ac2-ac3b-2aeb41d1d887 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0804679 Nov 11 11:55:24.777605 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-b1b57194-b2b2-4b0c-bc19-e71c76b2f8da service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1138 time: 0.1140499 Nov 11 11:55:24.950392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-0b7fa21b-2437-402a-8cec-114f78ae72a4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:24.952051 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-0b7fa21b-2437-402a-8cec-114f78ae72a4 service neutron] 10.222.0.60 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 917 time: 0.1549973 Nov 11 11:55:25.064926 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-7230c4ad-af41-47e1-9c82-6acc4683a727 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 1002 time: 0.1051526 Nov 11 11:55:25.152148 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-15916257-0820-41c7-88eb-368623a0b16f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:25.153722 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-15916257-0820-41c7-88eb-368623a0b16f service neutron] 10.222.0.60 "GET /v2.0/subnets?id=74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 200 len: 854 time: 0.0829604 Nov 11 11:55:25.235483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-8d369147-145d-46e7-a8bc-60b51b722b6d service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0745549 Nov 11 11:55:25.381590 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-9b51aebf-a039-4ca6-94b9-54d700a0e08a service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1394184 Nov 11 11:55:25.535009 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2a75a893-d6bd-4713-9f8c-2af4631a0484 req-ea545b2a-4c68-4699-aeff-359b62d584f8 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1471033 Nov 11 11:55:28.042285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41500) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:55:28.201461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:28.236233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:55:28.240378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Usage tracker for resource:security_group_rule and tenant:5411a02de5964b46b58b5b4df66f29de is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:55:28.243415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:55:28.249433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:55:28.316137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:28.365737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:28.373222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-aaa4b7e7-72cd-4cf1-b472-492f22175d24 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:28.420951 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8e8939e-9176-4a59-b348-2e592df6820a,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:28.427463 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5411a02de5964b46b58b5b4df66f29de&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3840642 Nov 11 11:55:28.430394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41506) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:55:28.433194 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.433611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.434018 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.434421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.434857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.435244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.435646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.436043 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.436443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.436828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.437219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:28.441824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5d899c81-84b9-4bc1-a0ea-cf9cec037b7e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:28.501821 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-73f7f900-5588-4cfe-8ad7-d412afa66580 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:28.529635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-73f7f900-5588-4cfe-8ad7-d412afa66580 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:28.600331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-73f7f900-5588-4cfe-8ad7-d412afa66580 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:28.605657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-150dc2e9-eb41-400c-a3da-5e4ffd0d9eb2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:28.618215 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:55:28.623634 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f7f900-5588-4cfe-8ad7-d412afa66580 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8e8939e-9176-4a59-b348-2e592df6820a,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:28.628004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-73f7f900-5588-4cfe-8ad7-d412afa66580 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:28.633651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-73f7f900-5588-4cfe-8ad7-d412afa66580 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:28.634921 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-73f7f900-5588-4cfe-8ad7-d412afa66580 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b8e8939e-9176-4a59-b348-2e592df6820a HTTP/1.1" status: 204 len: 168 time: 0.2034020 Nov 11 11:55:29.734069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41528) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:55:29.879854 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-841883679-network', 'tenant_id': '2942609a1bb4440b9e6bdb1e669bbd81'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:55:29.885122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:55:29.889302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Usage tracker for resource:network and tenant:2942609a1bb4440b9e6bdb1e669bbd81 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:55:29.892372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:55:29.898445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:55:29.936587 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Made reservation on behalf of 2942609a1bb4440b9e6bdb1e669bbd81 for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:55:29.941400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:29.955225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:29.991504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:55:29.995530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Usage tracker for resource:security_group_rule and tenant:2942609a1bb4440b9e6bdb1e669bbd81 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:55:29.998487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:55:30.004561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:55:30.074787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:30.114849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:30.119613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-12d16ae7-b13a-48ff-87a6-8096fcd00f4e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:30.149867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1004} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:55:30.163868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=387b162c-a83f-4d10-92de-efa38ad49aab,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:30.170088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:30.176032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:30.176032 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Added segment 759b06c7-8439-45c2-977b-f3cad3321ad8 of type vlan for network aef5a8ae-7e84-4add-82f9-2bcffa7c563b Nov 11 11:55:30.245757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:30.303477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:30.304802 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:30.305450 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:30.310772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:30.421742 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Pushing event updated for resources: {'Network': ['ID=aef5a8ae-7e84-4add-82f9-2bcffa7c563b,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:30.423124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:30.431718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network aef5a8ae-7e84-4add-82f9-2bcffa7c563b details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:55:30.458847 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.7235439 Nov 11 11:55:30.461926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41534) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:55:30.468362 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Request body: {'subnet': {'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-841883679-subnet', 'tenant_id': '2942609a1bb4440b9e6bdb1e669bbd81', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:55:30.474603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:55:30.479028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Usage tracker for resource:subnet and tenant:2942609a1bb4440b9e6bdb1e669bbd81 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:55:30.482269 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:55:30.489140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:55:30.595081 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Made reservation on behalf of 2942609a1bb4440b9e6bdb1e669bbd81 for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:55:30.600858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036852136936'] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:31.063232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created--9223372036852097580', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036852136951'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:31.069079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:31.146983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Pushing event updated for resources: {'Subnet': ['ID=366275ac-3cf8-41a5-a3b7-ba8870dbc4a6,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:31.151454 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:31.160700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Checking segment: {'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:55:31.161103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Network hostable DHCP agents. Network: aef5a8ae-7e84-4add-82f9-2bcffa7c563b, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:55:31.212171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Network aef5a8ae-7e84-4add-82f9-2bcffa7c563b is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:55:31.252222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, aef5a8ae-7e84-4add-82f9-2bcffa7c563b) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:55:31.257002 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:31.257646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:31.262675 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1cad820-1d42-4d68-bc6f-14cf22bf1ed9 None None] Network aef5a8ae-7e84-4add-82f9-2bcffa7c563b requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:55:31.315900 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0fcf2b08-d5cd-4064-9ece-4ffff64bbb92 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8526521 Nov 11 11:55:31.497534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3e8c550-2c4f-4ff9-825d-82d49a629732 None None] Network aef5a8ae-7e84-4add-82f9-2bcffa7c563b requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:55:34.287868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-d84016dc-5750-4571-a1e2-825b748f4650 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:34.289475 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-d84016dc-5750-4571-a1e2-825b748f4650 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/networks?id=aef5a8ae-7e84-4add-82f9-2bcffa7c563b HTTP/1.1" status: 200 len: 808 time: 0.3775721 Nov 11 11:55:34.308223 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f5c009ce-eab6-4f39-a674-539fbe2573f3 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/quotas/2942609a1bb4440b9e6bdb1e669bbd81 HTTP/1.1" status: 200 len: 375 time: 0.0124073 Nov 11 11:55:34.359640 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-cd508300-5aad-4a30-b9fa-a2afc26deabd tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=2942609a1bb4440b9e6bdb1e669bbd81&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0456111 Nov 11 11:55:34.507609 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-fb269e7d-4e97-4d95-8b77-052af759a91e service neutron] 10.222.0.11 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1403248 Nov 11 11:55:34.655124 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-de28626b-2a33-42bd-8bc2-0b793e89849d service neutron] 10.222.0.11 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1409371 Nov 11 11:55:34.813024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:36.105232 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9fb9f462-4440-41be-985c-58e1b3dc0f83 req-ede808a3-1fbe-478b-aac2-73a174b5fac4 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 210 time: 0.2221761 Nov 11 11:55:37.289762 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-501974f5-19b1-4c8c-b02c-19c7df75584b req-39071d2f-8417-4418-a024-12de081ddf4b tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 210 time: 0.0551431 Nov 11 11:55:37.760430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-df13488f-2dcb-45f9-94e8-16282fc72161 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:37.762032 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-df13488f-2dcb-45f9-94e8-16282fc72161 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.60 "GET /v2.0/networks?id=aef5a8ae-7e84-4add-82f9-2bcffa7c563b HTTP/1.1" status: 200 len: 808 time: 0.1679499 Nov 11 11:55:37.778741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Request body: {'port': {'device_id': 'e68cc724-f89d-461f-8b95-27ccf544503c', 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b', 'admin_state_up': True, 'tenant_id': '2942609a1bb4440b9e6bdb1e669bbd81'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:55:37.931514 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:55:37.936863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Usage tracker for resource:port and tenant:2942609a1bb4440b9e6bdb1e669bbd81 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:55:37.940296 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:55:37.949016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:55:37.985300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Made reservation on behalf of 2942609a1bb4440b9e6bdb1e669bbd81 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:55:37.991297 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:38.169181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Allocated IP 172.20.0.2 (aef5a8ae-7e84-4add-82f9-2bcffa7c563b/366275ac-3cf8-41a5-a3b7-ba8870dbc4a6/fc5cdb70-49fa-4fa3-b024-bf28847ea0b8) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:55:38.386084 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:38.464059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:38.473911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:38.564722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Network aef5a8ae-7e84-4add-82f9-2bcffa7c563b is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:55:38.569858 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Pushing event updated for resources: {'Port': ['ID=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:38.573651 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:55:38.575671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:38.578172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:55:38.646121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c56a8d-7830-41d7-908f-9d85f8f309e3 req-f93d7c0a-2da2-4c56-8ce0-ecd9cafc856c tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:38.647744 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-69c56a8d-7830-41d7-908f-9d85f8f309e3 req-f93d7c0a-2da2-4c56-8ce0-ecd9cafc856c tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 931 time: 0.2236097 Nov 11 11:55:38.662209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:38.662878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:38.728534 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-69c56a8d-7830-41d7-908f-9d85f8f309e3 req-975973c7-ecbd-4b71-ae55-96917a8ceabb tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720110 Nov 11 11:55:38.757585 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9835167 Nov 11 11:55:38.770241 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Request body: {'port': {'device_id': 'e68cc724-f89d-461f-8b95-27ccf544503c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:55:38.886866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:39.265123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:55:39.272822 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:39.289236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Transition to ACTIVE for port object fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:55:39.322404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:39.327233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9a0e1343-d64e-464a-b2b6-4fd98489f75a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:39.460246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Pushing event updated for resources: {'Port': ['ID=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:39.463459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:39.581387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Attempting to bind port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:55:39.581764 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Attempting to bind port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:55:39.582665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Attempting to bind port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 on network aef5a8ae-7e84-4add-82f9-2bcffa7c563b {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:55:39.588975 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 on network aef5a8ae-7e84-4add-82f9-2bcffa7c563b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:55:39.589336 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Attempting to bind port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 on network aef5a8ae-7e84-4add-82f9-2bcffa7c563b {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:55:39.596662 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 55, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:55:39.597046 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Checking segment: {'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:55:39.597467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Bound using segment: {'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:55:39.598567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Bound port: fc5cdb70-49fa-4fa3-b024-bf28847ea0b8, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:55:39.598992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:39.695501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] For port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:55:39.698726 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] For port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:55:39.746628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:39.750988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:39.810011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:39.811531 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] 10.222.0.60 "PUT /v2.0/ports/fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 HTTP/1.1" status: 200 len: 1093 time: 1.0465143 Nov 11 11:55:39.812079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e68cc724-f89d-461f-8b95-27ccf544503c', 'tag': 'fc5cdb70-49fa-4fa3-b024-bf28847ea0b8'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:55:39.838284 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Pushing event updated for resources: {'Port': ['ID=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:39.842145 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:39.901563 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e68cc724-f89d-461f-8b95-27ccf544503c', 'tag': 'fc5cdb70-49fa-4fa3-b024-bf28847ea0b8', 'status': 'completed', 'code': 200} Nov 11 11:55:40.010905 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c861ceae-b93a-4a35-9015-800852c4f5fa req-2f9b6214-a28a-46cf-b8d0-10128fbb6ef8 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:40.011697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c861ceae-b93a-4a35-9015-800852c4f5fa req-2f9b6214-a28a-46cf-b8d0-10128fbb6ef8 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Synchronizing usage tracker for tenant:2942609a1bb4440b9e6bdb1e669bbd81 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:55:40.018929 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-2cda8fa9-0d5a-47ba-b02b-68726c0676a0 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=2942609a1bb4440b9e6bdb1e669bbd81&device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 1096 time: 0.1196313 Nov 11 11:55:40.042411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c823263d-f04a-44e6-9fc8-31729c36adf8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:40.100191 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-66582d7b-ff8b-49a3-9870-fdcabf74c654 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 HTTP/1.1" status: 200 len: 217 time: 0.0713863 Nov 11 11:55:40.143242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-c861ceae-b93a-4a35-9015-800852c4f5fa req-2f9b6214-a28a-46cf-b8d0-10128fbb6ef8 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Unset dirty status for tenant:2942609a1bb4440b9e6bdb1e669bbd81 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:55:40.144550 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c861ceae-b93a-4a35-9015-800852c4f5fa req-2f9b6214-a28a-46cf-b8d0-10128fbb6ef8 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 943 time: 0.2853384 Nov 11 11:55:40.201954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-449be0a4-3163-4173-95cf-bc15e9b270db service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:40.203535 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-449be0a4-3163-4173-95cf-bc15e9b270db service neutron] 10.222.0.60 "GET /v2.0/subnets?id=366275ac-3cf8-41a5-a3b7-ba8870dbc4a6 HTTP/1.1" status: 200 len: 848 time: 0.0973527 Nov 11 11:55:40.251182 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c861ceae-b93a-4a35-9015-800852c4f5fa req-fcc48b87-bcda-4816-92eb-bb502fcb3a5c tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0943866 Nov 11 11:55:40.258343 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-e7065502-edb9-4973-9fc3-651ff60af25b service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=aef5a8ae-7e84-4add-82f9-2bcffa7c563b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0483594 Nov 11 11:55:40.405209 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-b3fe9f18-8d6a-4f1a-9fb0-d7e8d2c70036 service neutron] 10.222.0.60 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1405334 Nov 11 11:55:40.567804 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7c535a11-1298-4ef4-a315-635e4dce1d71 req-1dca169f-6c65-4f82-83dc-1a62a4f9ec2c service neutron] 10.222.0.60 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1555984 Nov 11 11:55:40.734005 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-1acddb7a-2de6-4bb6-9445-126f802d2eb4 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=2942609a1bb4440b9e6bdb1e669bbd81&device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 1096 time: 0.0824478 Nov 11 11:55:41.099474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-f6c77916-4300-4ac4-bf6e-f77c32b3a38f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:41.101000 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-f6c77916-4300-4ac4-bf6e-f77c32b3a38f service neutron] 10.222.0.60 "GET /v2.0/networks?id=aef5a8ae-7e84-4add-82f9-2bcffa7c563b HTTP/1.1" status: 200 len: 910 time: 0.3606980 Nov 11 11:55:41.177010 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-f59ebb7c-fc4d-41f1-9f1d-8a4689629197 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 HTTP/1.1" status: 200 len: 217 time: 0.0687845 Nov 11 11:55:41.248618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-213b2bb9-7d72-48f7-a08a-63b109f76683 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:41.251163 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-213b2bb9-7d72-48f7-a08a-63b109f76683 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=366275ac-3cf8-41a5-a3b7-ba8870dbc4a6 HTTP/1.1" status: 200 len: 848 time: 0.0667906 Nov 11 11:55:41.271896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:41.312488 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-d3b10edb-ca8a-4a17-883c-35c8c6c3ed1c service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=aef5a8ae-7e84-4add-82f9-2bcffa7c563b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0551229 Nov 11 11:55:41.520592 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-34db07cb-3441-4821-afe9-bcf713c66673 service neutron] 10.222.0.60 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2006295 Nov 11 11:55:41.589805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089b4072-46b2-4eb6-b205-2d8624243a92 req-9b5aed9e-0c13-4321-9b15-c613ea363aa0 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:41.591480 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089b4072-46b2-4eb6-b205-2d8624243a92 req-9b5aed9e-0c13-4321-9b15-c613ea363aa0 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 943 time: 0.1757393 Nov 11 11:55:41.718807 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-089b4072-46b2-4eb6-b205-2d8624243a92 req-eddb844d-5439-4343-921a-4f5930c2e49c tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1203136 Nov 11 11:55:41.737108 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5b8b509-a595-43cf-b8c8-4e591eb709b3 req-2b21070a-8374-45b3-beb2-f8a2998314d7 service neutron] 10.222.0.60 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2021878 Nov 11 11:55:42.933789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c910aa39-b168-48a5-a31a-ece07813de9e req-7b54af21-7fee-45c7-be4e-c8d0ac045174 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:42.935437 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c910aa39-b168-48a5-a31a-ece07813de9e req-7b54af21-7fee-45c7-be4e-c8d0ac045174 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 943 time: 0.0893173 Nov 11 11:55:42.997424 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c910aa39-b168-48a5-a31a-ece07813de9e req-524508ce-581e-445f-a8e2-330db3748384 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556393 Nov 11 11:55:43.403535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:55:43.517621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-67d5a65b-6401-49f4-8526-4c31872b4def None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:43.585211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:55:43.593607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:43.600763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': 'fc5cdb70-49fa-4fa3-b024-bf28847ea0b8', 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b', 'port_id': 'fc5cdb70-49fa-4fa3-b024-bf28847ea0b8', 'mac_address': 'fa:16:3e:9a:3f:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1004, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '366275ac-3cf8-41a5-a3b7-ba8870dbc4a6', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:55:43.664682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:43.683491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:55:43.699492 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:55:43.741193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:43.743140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-20e8cd1d-f5d7-44f8-9dfd-c3b064ee53dd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:43.809472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:43.821283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.821680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.822063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.822449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.822851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.823223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.823600 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.823976 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.824347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.824713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.825086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:55:43.829228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:44.100343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['fc5cdb70-49fa-4fa3-b024-bf28847ea0b8'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:55:44.221093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12793806-eee8-4369-92f9-0013803742bc req-f1da24ef-91e4-4fcb-8499-bfe4f8ad75ab tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:44.222753 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-12793806-eee8-4369-92f9-0013803742bc req-f1da24ef-91e4-4fcb-8499-bfe4f8ad75ab tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 944 time: 0.0891888 Nov 11 11:55:44.274766 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-12793806-eee8-4369-92f9-0013803742bc req-6fe8ef3d-ee93-43dd-8945-c4df526b7d12 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454259 Nov 11 11:55:44.688891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:45.423997 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:55:45.494998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-202da445-1243-4d5d-a3da-427b3a70b03d req-e5f563ad-cf90-445d-9fb5-468de1f95764 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:45.496791 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-202da445-1243-4d5d-a3da-427b3a70b03d req-e5f563ad-cf90-445d-9fb5-468de1f95764 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 944 time: 0.0952814 Nov 11 11:55:45.563814 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-202da445-1243-4d5d-a3da-427b3a70b03d req-ac81bc64-c00a-434a-9833-c39281d05654 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559511 Nov 11 11:55:45.581642 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:55:45.591559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:55:45.592271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:45.726921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:45.755671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e68cc724-f89d-461f-8b95-27ccf544503c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fc5cdb70-49fa-4fa3-b024-bf28847ea0b8'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:55:45.766515 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:55:45.804541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:45.806612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:45.842357 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e68cc724-f89d-461f-8b95-27ccf544503c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fc5cdb70-49fa-4fa3-b024-bf28847ea0b8', 'code': 200} Nov 11 11:55:45.879213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:45.882777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:46.114118 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-310bd9ce-65c0-4fe0-b44b-e6c29d67780c req-46402b34-6a2f-4125-be82-f8f48c9077b2 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 1098 time: 0.0736222 Nov 11 11:55:46.157896 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-310bd9ce-65c0-4fe0-b44b-e6c29d67780c req-eb9eff00-98ce-44c4-a826-5e98e865282c service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378368 Nov 11 11:55:46.796138 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cea60d8-6541-4c0a-b9ab-33c08d40e40b req-29ac6c34-0cba-49e3-8b54-5a85d39a10c8 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:46.797770 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0cea60d8-6541-4c0a-b9ab-33c08d40e40b req-29ac6c34-0cba-49e3-8b54-5a85d39a10c8 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 945 time: 0.0848413 Nov 11 11:55:46.846462 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0cea60d8-6541-4c0a-b9ab-33c08d40e40b req-f13ac737-04d2-4a80-a030-1c5e280ef950 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420313 Nov 11 11:55:48.054494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5e6456-5e5d-4eab-9321-9b45f4deaaff req-775e6181-e68c-47df-8441-6451ce6cfd0c tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:48.056127 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4f5e6456-5e5d-4eab-9321-9b45f4deaaff req-775e6181-e68c-47df-8441-6451ce6cfd0c tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 945 time: 0.0841663 Nov 11 11:55:48.107529 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4f5e6456-5e5d-4eab-9321-9b45f4deaaff req-6bc28cc3-141a-4059-a14b-e0664e4abe6a tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452232 Nov 11 11:55:49.440315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d84056-2455-44af-9638-15501e77a63a req-e24d6449-5879-4ca7-ada7-aeffbe3cfae3 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:49.441951 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-14d84056-2455-44af-9638-15501e77a63a req-e24d6449-5879-4ca7-ada7-aeffbe3cfae3 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 945 time: 0.0851235 Nov 11 11:55:49.500403 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-14d84056-2455-44af-9638-15501e77a63a req-52152354-b948-4f31-bbd8-9cbf72857c6f tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516820 Nov 11 11:55:50.720604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2460f20-8761-4f03-be79-ec7541d35376 req-18be70f6-df76-4fe9-8ef1-b01a0c78f808 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:50.722055 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c2460f20-8761-4f03-be79-ec7541d35376 req-18be70f6-df76-4fe9-8ef1-b01a0c78f808 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 945 time: 0.0888319 Nov 11 11:55:50.771902 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c2460f20-8761-4f03-be79-ec7541d35376 req-71b3310f-73da-4237-81d7-06684370137c tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435333 Nov 11 11:55:51.058597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-98b3386b-e99a-44ba-b08b-e1bfb38eaacd tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:51.060190 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-98b3386b-e99a-44ba-b08b-e1bfb38eaacd tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.60 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 945 time: 0.0880086 Nov 11 11:55:51.138768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Deleting port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:55:51.139080 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:51.402538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] For port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:55:51.402857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:51.532911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Calling delete_port for fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:55:51.822000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:51.828806 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:51.834319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['fc5cdb70-49fa-4fa3-b024-bf28847ea0b8'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:55:51.874909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Pushing event deleted for resources: {'Port': ['ID=fc5cdb70-49fa-4fa3-b024-bf28847ea0b8,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:51.878210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:52.001989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] No DVR routers for this DVR port fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:55:52.005503 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3cee1770-c557-469e-a635-88ca3abc4323 req-edc7d1e8-55f6-4a96-bb07-d632fb55bde5 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e68cc724-f89d-461f-8b95-27ccf544503c HTTP/1.1" status: 200 len: 210 time: 0.0868356 Nov 11 11:55:52.006555 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:52.010612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e68cc724-f89d-461f-8b95-27ccf544503c', 'name': 'network-vif-deleted', 'tag': 'fc5cdb70-49fa-4fa3-b024-bf28847ea0b8'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:55:52.068468 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e61ca102-f7ef-4963-b67a-eea6fd05d7dd req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.60 "DELETE /v2.0/ports/fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 HTTP/1.1" status: 204 len: 173 time: 1.0013328 Nov 11 11:55:52.075521 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e68cc724-f89d-461f-8b95-27ccf544503c', 'name': 'network-vif-deleted', 'tag': 'fc5cdb70-49fa-4fa3-b024-bf28847ea0b8', 'status': 'completed', 'code': 200} Nov 11 11:55:53.418772 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13118ef3-806a-4f4e-8305-391f025fb52f req-3a8067de-230f-4911-b174-aa681bef8ec7 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:53.420359 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-3a8067de-230f-4911-b174-aa681bef8ec7 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/networks?id=aef5a8ae-7e84-4add-82f9-2bcffa7c563b HTTP/1.1" status: 200 len: 808 time: 0.1662858 Nov 11 11:55:53.438197 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-a51d34d8-0865-46c8-880f-465fd9d1b8c6 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/quotas/2942609a1bb4440b9e6bdb1e669bbd81 HTTP/1.1" status: 200 len: 375 time: 0.0118332 Nov 11 11:55:53.488610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-13118ef3-806a-4f4e-8305-391f025fb52f req-b70eb24a-be00-4026-8dce-aadc864614d9 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Synchronizing usage tracker for tenant:2942609a1bb4440b9e6bdb1e669bbd81 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:55:53.531272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-13118ef3-806a-4f4e-8305-391f025fb52f req-b70eb24a-be00-4026-8dce-aadc864614d9 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Unset dirty status for tenant:2942609a1bb4440b9e6bdb1e669bbd81 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:55:53.532775 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-b70eb24a-be00-4026-8dce-aadc864614d9 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=2942609a1bb4440b9e6bdb1e669bbd81&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0884190 Nov 11 11:55:53.683380 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-51488897-21ea-484f-8bc7-ee9dc320bf8e service neutron] 10.222.0.11 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1427283 Nov 11 11:55:53.827221 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-d8c22996-fd7d-442d-ab55-57ef0702bac8 service neutron] 10.222.0.11 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371071 Nov 11 11:55:54.138087 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cdc98bed-4372-485a-a680-ee2e3e49887a req-4b95156b-0be3-407f-a06d-61072cc483cb tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 210 time: 0.0455759 Nov 11 11:55:55.317591 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5c2afc7-b451-4e5c-ba84-e3ef905c385e req-5e0abdeb-aa13-45af-b647-0f8bc9c0c9f6 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 210 time: 0.0513380 Nov 11 11:55:55.475964 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:55:55.510442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:55:55.526516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device fc5cdb70-49fa-4fa3-b024-bf28847ea0b8 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:55:56.065135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13118ef3-806a-4f4e-8305-391f025fb52f req-cc9fb768-4d89-4a10-88f5-136db8a48026 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:56.066906 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-cc9fb768-4d89-4a10-88f5-136db8a48026 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.60 "GET /v2.0/networks?id=aef5a8ae-7e84-4add-82f9-2bcffa7c563b HTTP/1.1" status: 200 len: 808 time: 0.3881814 Nov 11 11:55:56.082716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Request body: {'port': {'device_id': '4e6bb3e4-4e16-493d-aa19-f839f9c3b35e', 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b', 'admin_state_up': True, 'tenant_id': '2942609a1bb4440b9e6bdb1e669bbd81'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:55:56.226699 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:55:56.236981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:55:56.280478 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Made reservation on behalf of 2942609a1bb4440b9e6bdb1e669bbd81 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:55:56.286896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:56.502060 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a3cb4ba-3ff5-48f1-98d0-d82bae2179c2 req-7b5329da-d2f1-4beb-b596-3ad7a4397e47 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 210 time: 0.0537796 Nov 11 11:55:56.517767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Allocated IP 172.20.0.10 (aef5a8ae-7e84-4add-82f9-2bcffa7c563b/366275ac-3cf8-41a5-a3b7-ba8870dbc4a6/54af2be0-19ab-4fec-95c5-45476e76d4bd) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:55:56.887615 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:56.943558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:56.949574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:57.018843 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Network aef5a8ae-7e84-4add-82f9-2bcffa7c563b is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:55:57.027087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:55:57.032491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:55:57.066957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Pushing event updated for resources: {'Port': ['ID=54af2be0-19ab-4fec-95c5-45476e76d4bd,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:57.074007 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:57.103666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:57.104340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:57.153865 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0754762 Nov 11 11:55:57.167377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Request body: {'port': {'device_id': '4e6bb3e4-4e16-493d-aa19-f839f9c3b35e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:55:57.284818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:57.639641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 54af2be0-19ab-4fec-95c5-45476e76d4bd {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:55:57.648568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:57.715207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Transition to ACTIVE for port object 54af2be0-19ab-4fec-95c5-45476e76d4bd will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:55:57.746079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4cdde9d-ceca-46db-8d18-af18f3236681 req-8527b090-826e-41a5-96a5-dc94e223dff6 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:57.746828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b4cdde9d-ceca-46db-8d18-af18f3236681 req-8527b090-826e-41a5-96a5-dc94e223dff6 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Synchronizing usage tracker for tenant:2942609a1bb4440b9e6bdb1e669bbd81 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:55:57.751285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:57.755745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4c3f8c36-36b7-4c1a-87ee-d1e446a6ec1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:57.878437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b4cdde9d-ceca-46db-8d18-af18f3236681 req-8527b090-826e-41a5-96a5-dc94e223dff6 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Unset dirty status for tenant:2942609a1bb4440b9e6bdb1e669bbd81 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:55:57.879739 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b4cdde9d-ceca-46db-8d18-af18f3236681 req-8527b090-826e-41a5-96a5-dc94e223dff6 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 932 time: 0.2357836 Nov 11 11:55:57.891173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Pushing event updated for resources: {'Port': ['ID=54af2be0-19ab-4fec-95c5-45476e76d4bd,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:57.907694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:58.014597 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b4cdde9d-ceca-46db-8d18-af18f3236681 req-f2a4ab1b-9b81-456a-9e65-aedbe69dc5c9 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244252 Nov 11 11:55:58.044338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Attempting to bind port 54af2be0-19ab-4fec-95c5-45476e76d4bd on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:55:58.044719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Attempting to bind port 54af2be0-19ab-4fec-95c5-45476e76d4bd by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:55:58.045092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Attempting to bind port 54af2be0-19ab-4fec-95c5-45476e76d4bd on network aef5a8ae-7e84-4add-82f9-2bcffa7c563b {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:55:58.052805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Port 54af2be0-19ab-4fec-95c5-45476e76d4bd on network aef5a8ae-7e84-4add-82f9-2bcffa7c563b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:55:58.053170 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Attempting to bind port 54af2be0-19ab-4fec-95c5-45476e76d4bd on network aef5a8ae-7e84-4add-82f9-2bcffa7c563b {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:55:58.059816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 55, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:55:58.060193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Checking segment: {'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:55:58.060608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Bound using segment: {'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:55:58.061067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Bound port: 54af2be0-19ab-4fec-95c5-45476e76d4bd, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '759b06c7-8439-45c2-977b-f3cad3321ad8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1004, 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:55:58.061453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:58.151436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] For port 54af2be0-19ab-4fec-95c5-45476e76d4bd, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:55:58.154610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] For port 54af2be0-19ab-4fec-95c5-45476e76d4bd, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=54af2be0-19ab-4fec-95c5-45476e76d4bd,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:55:58.210624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:58.215942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-e2b4401f-b46f-4807-b978-92652d1f9e15 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:55:58.283510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:55:58.285025 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] 10.222.0.60 "PUT /v2.0/ports/54af2be0-19ab-4fec-95c5-45476e76d4bd HTTP/1.1" status: 200 len: 1094 time: 1.1227958 Nov 11 11:55:58.285568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e6bb3e4-4e16-493d-aa19-f839f9c3b35e', 'tag': '54af2be0-19ab-4fec-95c5-45476e76d4bd'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:55:58.306055 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Pushing event updated for resources: {'Port': ['ID=54af2be0-19ab-4fec-95c5-45476e76d4bd,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:55:58.307069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:55:58.344231 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e6bb3e4-4e16-493d-aa19-f839f9c3b35e', 'tag': '54af2be0-19ab-4fec-95c5-45476e76d4bd', 'status': 'completed', 'code': 200} Nov 11 11:55:58.440270 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-584b434a-a37e-47a8-860f-79f84ff16937 req-825f394c-bc31-4b20-8a78-1eb9c05ca10e service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=2942609a1bb4440b9e6bdb1e669bbd81&device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 1097 time: 0.0754499 Nov 11 11:55:58.591660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584b434a-a37e-47a8-860f-79f84ff16937 req-29563e7c-f5a4-43b3-a03f-67c1130b2fb3 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:58.593248 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-584b434a-a37e-47a8-860f-79f84ff16937 req-29563e7c-f5a4-43b3-a03f-67c1130b2fb3 service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=2942609a1bb4440b9e6bdb1e669bbd81&shared=False HTTP/1.1" status: 200 len: 910 time: 0.1462121 Nov 11 11:55:58.738914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584b434a-a37e-47a8-860f-79f84ff16937 req-5982e434-8f2a-4890-9bc7-5317316b6fb2 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:58.740554 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-584b434a-a37e-47a8-860f-79f84ff16937 req-5982e434-8f2a-4890-9bc7-5317316b6fb2 service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1409595 Nov 11 11:55:58.854693 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-57a1cce5-6fe9-417d-ad3b-393f4a6aa04d service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=2942609a1bb4440b9e6bdb1e669bbd81&device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 1097 time: 0.0769768 Nov 11 11:55:58.928221 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-8984f32b-aa52-47df-8bb0-02a00c0838dc service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=54af2be0-19ab-4fec-95c5-45476e76d4bd HTTP/1.1" status: 200 len: 217 time: 0.0663638 Nov 11 11:55:58.995982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13118ef3-806a-4f4e-8305-391f025fb52f req-2b7f1d44-a934-435b-86fb-61f5b8d74644 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:58.997462 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-2b7f1d44-a934-435b-86fb-61f5b8d74644 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=366275ac-3cf8-41a5-a3b7-ba8870dbc4a6 HTTP/1.1" status: 200 len: 848 time: 0.0626791 Nov 11 11:55:59.050854 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-584c65fd-f4b0-422f-bdb7-01bce46f2679 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=aef5a8ae-7e84-4add-82f9-2bcffa7c563b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0466423 Nov 11 11:55:59.247532 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-9f95d035-8b09-4dfc-97b4-d7f9cb0c8cbe service neutron] 10.222.0.60 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1896777 Nov 11 11:55:59.301891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93ba5cec-b98f-448c-b7e6-682e54349385 req-743e30bc-7cef-45e0-9718-62e689d9cf95 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:55:59.303466 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-93ba5cec-b98f-448c-b7e6-682e54349385 req-743e30bc-7cef-45e0-9718-62e689d9cf95 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 944 time: 0.1594448 Nov 11 11:55:59.433622 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-93ba5cec-b98f-448c-b7e6-682e54349385 req-9b80efc7-a06e-437c-ba64-df10eb65787c tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771468 Nov 11 11:55:59.439232 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13118ef3-806a-4f4e-8305-391f025fb52f req-840333c2-d135-438b-9c3b-8a0f63f12aac service neutron] 10.222.0.60 "GET /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1830430 Nov 11 11:56:00.655639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd49f175-0619-441e-a235-9b5c74ac9ca8 req-3d5bb233-5d3c-4f83-946c-ee7e07e3d132 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:00.657557 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd49f175-0619-441e-a235-9b5c74ac9ca8 req-3d5bb233-5d3c-4f83-946c-ee7e07e3d132 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 944 time: 0.0954556 Nov 11 11:56:00.708702 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd49f175-0619-441e-a235-9b5c74ac9ca8 req-37c7a670-6693-4589-beb0-f33f315dc8a8 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446470 Nov 11 11:56:01.622932 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-c3a391e6-4c8c-4f40-aef0-5c1c59b9f649 req-3351bf0a-3731-42db-abfa-5ce1057c6f79 service neutron] (88329) timed out ('10.222.0.60', 64966) {{(pid=88329) process_request /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:830}} Nov 11 11:56:01.934526 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e9af87-abc1-4d51-bf01-caf6207177c6 req-2c43506d-cdbc-4cce-856e-63d8a54894af tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:01.936147 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-77e9af87-abc1-4d51-bf01-caf6207177c6 req-2c43506d-cdbc-4cce-856e-63d8a54894af tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 944 time: 0.0997312 Nov 11 11:56:01.993301 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-77e9af87-abc1-4d51-bf01-caf6207177c6 req-9c6fa998-bdd2-4e4f-bbb1-28d3c1e658e4 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500438 Nov 11 11:56:03.413299 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-39a48063-d5a1-45fc-8567-b3afb5c60306 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1748416726&fields=id&tenant_id=08033101aa064f2da647814019558d4e HTTP/1.1" status: 200 len: 267 time: 0.3143435 Nov 11 11:56:03.503533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f1b51f3-e52c-48a3-8fd9-b2ec85b304b6 req-07abcae4-4d9f-43fe-8d90-ed927b87be20 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:03.505143 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6f1b51f3-e52c-48a3-8fd9-b2ec85b304b6 req-07abcae4-4d9f-43fe-8d90-ed927b87be20 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 944 time: 0.3663619 Nov 11 11:56:03.525125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 54af2be0-19ab-4fec-95c5-45476e76d4bd details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:56:03.550039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-ecd7eda4-3280-4ef9-8adf-fa56cccf9312 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:03.551669 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-ecd7eda4-3280-4ef9-8adf-fa56cccf9312 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 985 time: 0.1297584 Nov 11 11:56:03.570348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Request body: {'port': {'security_groups': ['091599ea-1d12-4fa6-b21a-4de8f0f3d035']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:03.617762 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6f1b51f3-e52c-48a3-8fd9-b2ec85b304b6 req-8d9f7cc5-368b-4980-ab7f-5150b408e48d tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004500 Nov 11 11:56:03.671895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 54af2be0-19ab-4fec-95c5-45476e76d4bd, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=54af2be0-19ab-4fec-95c5-45476e76d4bd,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:03.688073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '54af2be0-19ab-4fec-95c5-45476e76d4bd', 'network_id': 'aef5a8ae-7e84-4add-82f9-2bcffa7c563b', 'port_id': '54af2be0-19ab-4fec-95c5-45476e76d4bd', 'mac_address': 'fa:16:3e:ed:07:c7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1004, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '366275ac-3cf8-41a5-a3b7-ba8870dbc4a6', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:56:03.710102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:03.746559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:03.765645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 54af2be0-19ab-4fec-95c5-45476e76d4bd {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:56:03.781256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 54af2be0-19ab-4fec-95c5-45476e76d4bd, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=54af2be0-19ab-4fec-95c5-45476e76d4bd,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:03.812788 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:03.814673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2d2383ad-b88f-44a2-8d2e-c50645bc3b1b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:03.883511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=54af2be0-19ab-4fec-95c5-45476e76d4bd,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:03.887301 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:03.968733 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] For port 370e3435-46b3-4afc-bb1d-6461d4bd991b, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:03.994770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.030205 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.036499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b7908493-a870-4845-8abb-2876ce641b2e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:04.041851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['370e3435-46b3-4afc-bb1d-6461d4bd991b'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:56:04.108031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:04.108720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.111814 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b8998bda-f240-4654-9d6c-0d8e314f4f5a req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "PUT /v2.0/ports/370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 943 time: 0.5487611 Nov 11 11:56:04.113185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:56:04.118744 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41678) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:04.136440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['54af2be0-19ab-4fec-95c5-45476e76d4bd'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:56:04.151931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event updated for resources: {'Port': ['ID=370e3435-46b3-4afc-bb1d-6461d4bd991b,revision_number=7']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:04.155459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:04.202383 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'status': 'completed', 'code': 200} Nov 11 11:56:04.205903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.210537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['370e3435-46b3-4afc-bb1d-6461d4bd991b'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:56:04.248581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.332870 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-7cc0d2b8-e8d2-4bee-b46b-2e43885108c6 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1099 time: 0.1038566 Nov 11 11:56:04.464660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.471563 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-13040735-8939-499f-9500-c296aa794f1e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:04.484196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-3565af2f-b85a-4f05-88ef-a87a2d631183 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:04.486055 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-3565af2f-b85a-4f05-88ef-a87a2d631183 service neutron] 10.222.0.60 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 917 time: 0.1464875 Nov 11 11:56:04.490580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=daef70c8-952a-438d-8bc5-0c7677b1fd83,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:04.498966 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.503267 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "DELETE /v2.0/security-groups/daef70c8-952a-438d-8bc5-0c7677b1fd83 HTTP/1.1" status: 204 len: 168 time: 0.3829086 Nov 11 11:56:04.504035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41684) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:04.572234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.572757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.573250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.573751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.574240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.574732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.575210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.575693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.576349 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.576631 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.577108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:04.591707 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3a596312-c330-4778-b0d4-05aaaf9de029 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:04.626053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-fe36a5c8-72c2-456e-a111-b3d65c2c7b8e None None] Provisioning complete for port 370e3435-46b3-4afc-bb1d-6461d4bd991b triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:04.626840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fe36a5c8-72c2-456e-a111-b3d65c2c7b8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.630610 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-3b75e624-c6d8-4eb4-a720-68d3b36dfda8 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 1002 time: 0.1384656 Nov 11 11:56:04.730696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-87555963-989e-4aaf-b5d3-7f6b7972ce5a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:04.733027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-87555963-989e-4aaf-b5d3-7f6b7972ce5a service neutron] 10.222.0.60 "GET /v2.0/subnets?id=74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 200 len: 854 time: 0.0953670 Nov 11 11:56:04.832218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:04.907483 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-70ac2f09-5a99-4b7f-ba81-3d2c6b1464b7 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1663980 Nov 11 11:56:04.914604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8749fa0d-d726-42a4-a9e5-d41eeab749c2 req-1097eba0-179a-4467-9eb3-dc86d5f6fba7 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:04.916735 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8749fa0d-d726-42a4-a9e5-d41eeab749c2 req-1097eba0-179a-4467-9eb3-dc86d5f6fba7 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 945 time: 0.1347888 Nov 11 11:56:04.994517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Deleting port 82706613-6a97-4216-a72f-9e95d24d69ae {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:04.994902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:05.069600 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8749fa0d-d726-42a4-a9e5-d41eeab749c2 req-e70283aa-643f-4c8a-a30a-36504ca995ae tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1308141 Nov 11 11:56:05.095944 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-e59c2b64-199e-44db-b47a-d888b08bb325 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1782005 Nov 11 11:56:05.181118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:05.181491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:05.241516 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49316fc4-ce37-4ebc-a362-1b68a25e6fe1 req-86532336-d345-48c9-a6e9-9f6929a3a96a service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1380386 Nov 11 11:56:05.310442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Calling delete_port for 82706613-6a97-4216-a72f-9e95d24d69ae owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:05.536887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 54af2be0-19ab-4fec-95c5-45476e76d4bd up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:05.612787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:05.617695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:05.619377 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:56:05.641418 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 54af2be0-19ab-4fec-95c5-45476e76d4bd completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:05.646911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 54af2be0-19ab-4fec-95c5-45476e76d4bd triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:05.647397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:05.660073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event deleted for resources: {'Port': ['ID=82706613-6a97-4216-a72f-9e95d24d69ae,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:05.664034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:05.761712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks [] for floatingip, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:05.777100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:05.805058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e6bb3e4-4e16-493d-aa19-f839f9c3b35e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54af2be0-19ab-4fec-95c5-45476e76d4bd'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:56:05.815904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 54af2be0-19ab-4fec-95c5-45476e76d4bd, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=54af2be0-19ab-4fec-95c5-45476e76d4bd,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:05.849904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:05.852045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:05.887918 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e6bb3e4-4e16-493d-aa19-f839f9c3b35e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54af2be0-19ab-4fec-95c5-45476e76d4bd', 'code': 200} Nov 11 11:56:05.930756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=54af2be0-19ab-4fec-95c5-45476e76d4bd,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:05.935021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:06.180607 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-421243a5-cfaf-4b06-adc0-33167575b549 req-870fadf5-c9dd-4619-8edb-d886f0a966ad service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 1099 time: 0.0820723 Nov 11 11:56:06.196291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Router 513d8c63-d622-434a-a3e7-a65baed1396c has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:56:06.278053 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-421243a5-cfaf-4b06-adc0-33167575b549 req-9e790b48-2d4d-4d94-b132-85147cc23197 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911763 Nov 11 11:56:06.307628 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6cd09ff-19c5-44bc-9296-9048dec38578 req-f515faf2-5ace-412d-8644-f1e7c44e6200 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:06.309290 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c6cd09ff-19c5-44bc-9296-9048dec38578 req-f515faf2-5ace-412d-8644-f1e7c44e6200 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 946 time: 0.1059811 Nov 11 11:56:06.362148 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c6cd09ff-19c5-44bc-9296-9048dec38578 req-8a056ed0-fd25-4cf7-899d-c674573c5476 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463996 Nov 11 11:56:06.421597 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:56:06.433167 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] Sync routers for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:56:06.446221 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:06.446899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:55:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:06.500671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:06.563593 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-1b2e8871-a3a6-447a-97d0-7e5c1af71e60 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "DELETE /v2.0/floatingips/5333dcdf-b770-4ab4-9627-6a4669cba527 HTTP/1.1" status: 204 len: 168 time: 2.0561821 Nov 11 11:56:06.564426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:56:06.625127 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'status': 'completed', 'code': 200} Nov 11 11:56:06.643757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:06.744222 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-69427513-7e00-41ca-b1fd-12afea72790d service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=08033101aa064f2da647814019558d4e&device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 1099 time: 0.0925121 Nov 11 11:56:06.903754 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-868438e1-8d01-4320-b991-34e0afa82e38 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:06.905491 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-868438e1-8d01-4320-b991-34e0afa82e38 service neutron] 10.222.0.60 "GET /v2.0/networks?id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 200 len: 917 time: 0.1547546 Nov 11 11:56:06.983612 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-e7944e89-65dd-4c99-9cfa-5beb857e2d84 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 200 len: 217 time: 0.0709581 Nov 11 11:56:07.013686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:27Z', 'revision_number': 5, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:07.018096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] Checking router: 513d8c63-d622-434a-a3e7-a65baed1396c for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:56:07.032685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:07.033736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:55:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:07.081223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-307c75de-c2bf-4c87-b9dc-20b888f16ab7 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:07.083075 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-307c75de-c2bf-4c87-b9dc-20b888f16ab7 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 200 len: 854 time: 0.0903199 Nov 11 11:56:07.177614 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-8ee0490e-810f-4874-8958-b814eb9c7778 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0812442 Nov 11 11:56:07.332351 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-4ec754d6-cd31-42c4-9ca6-d0a752911584 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1476023 Nov 11 11:56:07.387118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:07.485465 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bab6189d-ee70-4ea8-93d7-afd44e7533bb req-f3118e32-0ac4-4088-a4ba-be2eb63086a0 service neutron] 10.222.0.60 "GET /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1454768 Nov 11 11:56:07.605839 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3cecab9-e6fe-4b48-ad62-fd000fb5bc13 req-56f8af46-5715-4e01-8a4b-d3d4770f53a6 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:07.607534 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3cecab9-e6fe-4b48-ad62-fd000fb5bc13 req-56f8af46-5715-4e01-8a4b-d3d4770f53a6 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 946 time: 0.1040013 Nov 11 11:56:07.666393 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e3cecab9-e6fe-4b48-ad62-fd000fb5bc13 req-4e71a69d-d902-441e-a792-7ced2bb0bf9d tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493567 Nov 11 11:56:07.758791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:27Z', 'revision_number': 5, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:07.763039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-714c3f09-a2e2-46a2-959c-9dd5ca3483d7 None None] The sync data for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi is: [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:52:17Z', 'revision_number': 4, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'd790e034-e84c-4036-8b48-d5440f2583a2', 'name': '', 'network_id': '16848b15-b078-4b3f-a9fe-4cd0b9fefdf4', 'tenant_id': '08033101aa064f2da647814019558d4e', 'mac_address': 'fa:16:3e:27:f9:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:17Z', 'updated_at': '2021-11-11T11:52:27Z', 'revision_number': 5, 'project_id': '08033101aa064f2da647814019558d4e', 'subnets': [{'id': '74c32ff7-aa8c-4ebd-bce0-516dac9bf326', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:56:08.173316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c067a6dc-01d2-4902-a2c7-eb24ed1cf605 None None] New status for floating IP 5333dcdf-b770-4ab4-9627-6a4669cba527: DOWN {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:56:08.892474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4c9435-95c7-4ed9-9956-0656d80ed04b req-f24bf83f-bd2c-47f7-bc8f-07503e29f24f tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:08.894118 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-df4c9435-95c7-4ed9-9956-0656d80ed04b req-f24bf83f-bd2c-47f7-bc8f-07503e29f24f tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 946 time: 0.0840480 Nov 11 11:56:08.944170 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-df4c9435-95c7-4ed9-9956-0656d80ed04b req-31c9fc84-6b07-4bfe-90e5-d296163078e9 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438385 Nov 11 11:56:10.042252 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b3dc019b-df91-4cd7-bbf9-0793e2ac3e7f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:10.396029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8d0ca5-5441-4861-ad6b-98bc9e0553a4 req-d970bc41-fb76-4694-b24a-c53885584073 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:10.397527 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0f8d0ca5-5441-4861-ad6b-98bc9e0553a4 req-d970bc41-fb76-4694-b24a-c53885584073 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 946 time: 0.0851541 Nov 11 11:56:10.445606 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0f8d0ca5-5441-4861-ad6b-98bc9e0553a4 req-aac52578-ee72-4153-8726-fb359aaafb56 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420585 Nov 11 11:56:11.271090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:11.298505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bf07ad-a20c-4881-b4a1-13b44625c8ef req-1aafe152-0a50-4566-8fe3-06a5c4e3792a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:11.300221 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-33bf07ad-a20c-4881-b4a1-13b44625c8ef req-1aafe152-0a50-4566-8fe3-06a5c4e3792a tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.0839365 Nov 11 11:56:11.357134 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-33bf07ad-a20c-4881-b4a1-13b44625c8ef req-78d84355-231e-407b-a1cd-593330be75a6 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504889 Nov 11 11:56:11.656074 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b212d2eb-555b-4704-bcff-d01ff90496ec req-5af20a3b-bfaf-4a8a-a0bd-9c28551e2863 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:11.657687 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b212d2eb-555b-4704-bcff-d01ff90496ec req-5af20a3b-bfaf-4a8a-a0bd-9c28551e2863 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 946 time: 0.0839458 Nov 11 11:56:11.709365 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b212d2eb-555b-4704-bcff-d01ff90496ec req-7b19d25a-047e-48cb-b650-49405d8fe89d tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/security-groups?id=387b162c-a83f-4d10-92de-efa38ad49aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451252 Nov 11 11:56:11.870182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-880cebb5-f8f3-4f2d-a2bd-fa20243b1a31 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:11.871781 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-880cebb5-f8f3-4f2d-a2bd-fa20243b1a31 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.60 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 946 time: 0.0865378 Nov 11 11:56:11.946795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Deleting port 54af2be0-19ab-4fec-95c5-45476e76d4bd {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:11.947110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:12.214218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] For port 54af2be0-19ab-4fec-95c5-45476e76d4bd, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=54af2be0-19ab-4fec-95c5-45476e76d4bd,segment=NetworkSegment(759b06c7-8439-45c2-977b-f3cad3321ad8),segment_id=759b06c7-8439-45c2-977b-f3cad3321ad8)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:12.214626 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:12.557624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Calling delete_port for 54af2be0-19ab-4fec-95c5-45476e76d4bd owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:12.744502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd7b234a-87e1-4763-a7a7-398e42ea80c5 req-4d2ab905-da01-420c-be51-dc1c0a935b85 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:12.746115 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd7b234a-87e1-4763-a7a7-398e42ea80c5 req-4d2ab905-da01-420c-be51-dc1c0a935b85 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.1957040 Nov 11 11:56:12.811288 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd7b234a-87e1-4763-a7a7-398e42ea80c5 req-0c33417b-ba25-4f3c-87e1-c3c79f3d3ba4 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585282 Nov 11 11:56:12.819635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:12.834921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5edd6f6c-60cf-42f7-b79e-d32748a3f7aa tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:12.835908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['54af2be0-19ab-4fec-95c5-45476e76d4bd'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:56:12.911096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Pushing event deleted for resources: {'Port': ['ID=54af2be0-19ab-4fec-95c5-45476e76d4bd,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:12.918899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:12.949585 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b71010f-0ea7-436c-a3a4-31be83a7f795 req-a93d5f5c-eab6-4a09-b6c4-51952e43f4f8 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.11 "GET /v2.0/ports?device_id=4e6bb3e4-4e16-493d-aa19-f839f9c3b35e HTTP/1.1" status: 200 len: 210 time: 0.0774238 Nov 11 11:56:12.997184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] No DVR routers for this DVR port 54af2be0-19ab-4fec-95c5-45476e76d4bd on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:56:12.999599 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:13.002419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e6bb3e4-4e16-493d-aa19-f839f9c3b35e', 'name': 'network-vif-deleted', 'tag': '54af2be0-19ab-4fec-95c5-45476e76d4bd'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:56:13.043677 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ffdd2dc7-5e91-4868-ac1b-cfb39e0d1843 req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] 10.222.0.60 "DELETE /v2.0/ports/54af2be0-19ab-4fec-95c5-45476e76d4bd HTTP/1.1" status: 204 len: 173 time: 1.1654418 Nov 11 11:56:13.058844 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e6bb3e4-4e16-493d-aa19-f839f9c3b35e', 'name': 'network-vif-deleted', 'tag': '54af2be0-19ab-4fec-95c5-45476e76d4bd', 'status': 'completed', 'code': 200} Nov 11 11:56:13.392097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-405da5bf-7e98-47e4-b810-830c0fff343e req-24aa6ac8-13c1-482f-8127-703bf13a8ef5 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:13.393654 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-405da5bf-7e98-47e4-b810-830c0fff343e req-24aa6ac8-13c1-482f-8127-703bf13a8ef5 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.60 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.0857825 Nov 11 11:56:13.474076 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Deleting port 370e3435-46b3-4afc-bb1d-6461d4bd991b {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:13.474463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:13.503338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ed707269-c4c6-45c8-b425-849d63fbd6ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:13.540499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:13.755740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] For port 370e3435-46b3-4afc-bb1d-6461d4bd991b, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=370e3435-46b3-4afc-bb1d-6461d4bd991b,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:13.756617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:13.891694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Calling delete_port for 370e3435-46b3-4afc-bb1d-6461d4bd991b owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:14.109808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5cad22b-7fc9-4905-ab85-0a5c11599810 req-1be05043-90c2-49af-9ae2-76526d4de23f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:14.111519 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5cad22b-7fc9-4905-ab85-0a5c11599810 req-1be05043-90c2-49af-9ae2-76526d4de23f tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/ports?device_id=da29b497-f07f-4562-b681-42e65d990cba HTTP/1.1" status: 200 len: 946 time: 0.1661677 Nov 11 11:56:14.137537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:14.145933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f955794b-07eb-4e03-be55-1e41e70d0efa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:14.149734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['370e3435-46b3-4afc-bb1d-6461d4bd991b'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:56:14.200371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Pushing event deleted for resources: {'Port': ['ID=370e3435-46b3-4afc-bb1d-6461d4bd991b,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:14.207030 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:14.287549 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a5cad22b-7fc9-4905-ab85-0a5c11599810 req-283874f3-5abe-4d50-8a47-8e36825a0466 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.11 "GET /v2.0/security-groups?id=091599ea-1d12-4fa6-b21a-4de8f0f3d035&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1686349 Nov 11 11:56:14.293092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] No DVR routers for this DVR port 370e3435-46b3-4afc-bb1d-6461d4bd991b on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:56:14.295874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:14.306789 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-405da5bf-7e98-47e4-b810-830c0fff343e req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] 10.222.0.60 "DELETE /v2.0/ports/370e3435-46b3-4afc-bb1d-6461d4bd991b HTTP/1.1" status: 204 len: 173 time: 0.9069378 Nov 11 11:56:14.699805 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:15.060236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'name': 'network-vif-deleted', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:56:15.116176 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'da29b497-f07f-4562-b681-42e65d990cba', 'name': 'network-vif-deleted', 'tag': '370e3435-46b3-4afc-bb1d-6461d4bd991b', 'status': 'completed', 'code': 200} Nov 11 11:56:15.591832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 54af2be0-19ab-4fec-95c5-45476e76d4bd no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:56:15.627325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 54af2be0-19ab-4fec-95c5-45476e76d4bd {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:56:15.627866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 54af2be0-19ab-4fec-95c5-45476e76d4bd not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:56:15.628443 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 370e3435-46b3-4afc-bb1d-6461d4bd991b no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:56:15.662870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 370e3435-46b3-4afc-bb1d-6461d4bd991b {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:56:15.663508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 370e3435-46b3-4afc-bb1d-6461d4bd991b not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:56:16.828577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41842) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:17.234333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:18.086524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Deleting port d790e034-e84c-4036-8b48-d5440f2583a2 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:18.087119 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:18.264867 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] For port d790e034-e84c-4036-8b48-d5440f2583a2, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=d790e034-e84c-4036-8b48-d5440f2583a2,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:18.265270 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:18.390133 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Calling delete_port for d790e034-e84c-4036-8b48-d5440f2583a2 owned by network:router_interface {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:18.615239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:18.620021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bbd967e0-5bfa-4f17-a69f-8d7cb1bc90e6 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:18.663915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Pushing event deleted for resources: {'Port': ['ID=d790e034-e84c-4036-8b48-d5440f2583a2,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:18.668255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:18.970712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:19.575830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Router 513d8c63-d622-434a-a3e7-a65baed1396c has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:56:19.792933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:56:19.804088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] Sync routers for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:56:19.807969 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-218cce40-a5a2-4a57-971a-538c272d45aa admin admin] 10.222.0.11 "PUT /v2.0/routers/513d8c63-d622-434a-a3e7-a65baed1396c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9772296 Nov 11 11:56:19.811024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41858) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:19.821415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:19.822339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:20.036550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:20.039470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks [] for router, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:20.271095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:20.306958 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Deleting port 2bbb36ec-229e-423a-b6a6-4cce3c397610 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:20.307408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:20.353375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26'}], 'enable_snat': True}, 'gw_port_id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:56:18Z', 'revision_number': 5, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port': {'id': '2bbb36ec-229e-423a-b6a6-4cce3c397610', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:32:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:14Z', 'updated_at': '2021-11-11T11:52:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:20.357729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] Checking router: 513d8c63-d622-434a-a3e7-a65baed1396c for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:56:20.369673 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] Routers {'513d8c63-d622-434a-a3e7-a65baed1396c'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:20.370392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['513d8c63-d622-434a-a3e7-a65baed1396c'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:20.538590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] Set router 513d8c63-d622-434a-a3e7-a65baed1396c gateway port host: None {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:20.657204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:56:20Z', 'revision_number': 6, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port_host': None}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:20.662013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fc8498d-1228-4c9d-8726-8ed3ca6b8367 None None] The sync data for ids ['513d8c63-d622-434a-a3e7-a65baed1396c'] in dv-cinder-817417-1-iscsi is: [{'id': '513d8c63-d622-434a-a3e7-a65baed1396c', 'name': 'tempest-TestMinimumBasicScenario-1781542400-router', 'tenant_id': '08033101aa064f2da647814019558d4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:13Z', 'updated_at': '2021-11-11T11:56:20Z', 'revision_number': 6, 'project_id': '08033101aa064f2da647814019558d4e', 'gw_port_host': None}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:56:20.750530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] For port 2bbb36ec-229e-423a-b6a6-4cce3c397610, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=2bbb36ec-229e-423a-b6a6-4cce3c397610,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:20.751036 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:20.864173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device d790e034-e84c-4036-8b48-d5440f2583a2 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:56:20.896258 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Calling delete_port for 2bbb36ec-229e-423a-b6a6-4cce3c397610 owned by network:router_gateway {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:20.907027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: d790e034-e84c-4036-8b48-d5440f2583a2 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:56:20.907381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device d790e034-e84c-4036-8b48-d5440f2583a2 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:56:21.226247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:21.236001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:21.296012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Pushing event deleted for resources: {'Port': ['ID=2bbb36ec-229e-423a-b6a6-4cce3c397610,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:21.298996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:21.566989 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:21.872114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:21.877366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.038757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.039422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 513d8c63-d622-434a-a3e7-a65baed1396c {{(pid=88328) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 11:56:22.058998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.060424 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] 10.222.0.11 "DELETE /v2.0/routers/513d8c63-d622-434a-a3e7-a65baed1396c HTTP/1.1" status: 204 len: 168 time: 2.2481244 Nov 11 11:56:22.063011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41886) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:22.156654 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] Deleting subnet 74c32ff7-aa8c-4ebd-bce0-516dac9bf326 {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:56:22.162924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.245049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036850920695'] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.361962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.499536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2678040', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2638849'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.512663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b13cf932-5a80-471d-9a1a-90d251610439 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:22.601697 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=74c32ff7-aa8c-4ebd-bce0-516dac9bf326,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:22.607792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:22.609142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.615512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ddce84e-f31e-4d3b-967b-c885f60941aa None None] Network 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:56:22.627327 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c0ae6b42-6e64-4ade-bd81-92bfe5d5190d admin admin] 10.222.0.11 "DELETE /v2.0/subnets/74c32ff7-aa8c-4ebd-bce0-516dac9bf326 HTTP/1.1" status: 204 len: 168 time: 0.5624530 Nov 11 11:56:22.629956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41890) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:22.794695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.829321 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Deleting port 615d9db4-7679-47e3-9b84-646aaf1c900f {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:22.830027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:22.916506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 2bbb36ec-229e-423a-b6a6-4cce3c397610 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:56:22.963408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 2bbb36ec-229e-423a-b6a6-4cce3c397610 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:56:22.963808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 2bbb36ec-229e-423a-b6a6-4cce3c397610 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:56:22.967527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] DHCP port deletion for 16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 request from dv-cinder-817417-1-iscsi {{(pid=88330) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:247}} Nov 11 11:56:22.972732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] Deleting port 615d9db4-7679-47e3-9b84-646aaf1c900f {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:22.973164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:23.181572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] For port 615d9db4-7679-47e3-9b84-646aaf1c900f, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=615d9db4-7679-47e3-9b84-646aaf1c900f,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:23.182275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:23.247343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] For port 615d9db4-7679-47e3-9b84-646aaf1c900f, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=615d9db4-7679-47e3-9b84-646aaf1c900f,segment=NetworkSegment(79ee61d3-8883-4921-b5ea-a86abe95cc2c),segment_id=79ee61d3-8883-4921-b5ea-a86abe95cc2c)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:23.248126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:23.341518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Calling delete_port for 615d9db4-7679-47e3-9b84-646aaf1c900f owned by network:dhcp {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:23.412655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] Calling delete_port for 615d9db4-7679-47e3-9b84-646aaf1c900f owned by network:dhcp {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:23.467632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:23.474629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:23.539314 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Pushing event deleted for resources: {'Port': ['ID=615d9db4-7679-47e3-9b84-646aaf1c900f,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:23.541809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:56:23.542578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:23.543832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:56:23.545870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] No DVR routers for this DVR port 615d9db4-7679-47e3-9b84-646aaf1c900f on host dv-cinder-817417-1-iscsi {{(pid=88328) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:56:23.724298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:23.764831 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['16848b15-b078-4b3f-a9fe-4cd0b9fefdf4']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:23.787246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '79ee61d3-8883-4921-b5ea-a86abe95cc2c') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:23.787696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '79ee61d3-8883-4921-b5ea-a86abe95cc2c') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:23.809903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:23.835874 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:23.851911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Releasing vlan 1043 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:56:23.852852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:56:23.871142 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:56:24.046276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] Deleting port 615d9db4-7679-47e3-9b84-646aaf1c900f {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:24.047581 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:24.130231 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-4085d63b-27cb-4c3e-9711-8f2ab6a06555 None None] The port '615d9db4-7679-47e3-9b84-646aaf1c900f' was deleted {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1877}} Nov 11 11:56:24.177233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:24.182993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:24.187544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3221decf-87e5-4fd1-b8db-4da5822a6397 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:24.218069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Pushing event deleted for resources: {'Network': ['ID=16848b15-b078-4b3f-a9fe-4cd0b9fefdf4,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:24.220807 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:24.226909 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5dbf42c7-d7fd-4979-924a-86d6acbc4760 admin admin] 10.222.0.11 "DELETE /v2.0/networks/16848b15-b078-4b3f-a9fe-4cd0b9fefdf4 HTTP/1.1" status: 204 len: 168 time: 1.5913405 Nov 11 11:56:24.227717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41902) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:24.922236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 615d9db4-7679-47e3-9b84-646aaf1c900f no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:56:24.965538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 615d9db4-7679-47e3-9b84-646aaf1c900f {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:56:24.965942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 615d9db4-7679-47e3-9b84-646aaf1c900f not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:56:24.990554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:25.751077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Deleting port bbc8dfae-2d86-42bc-83ae-aa71e1207685 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:25.751671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:25.966868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] For port bbc8dfae-2d86-42bc-83ae-aa71e1207685, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=bbc8dfae-2d86-42bc-83ae-aa71e1207685,segment=NetworkSegment(182819e1-eced-44cf-a263-baf3680de8cd),segment_id=182819e1-eced-44cf-a263-baf3680de8cd)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:25.967189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:26.112591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Calling delete_port for bbc8dfae-2d86-42bc-83ae-aa71e1207685 owned by network:router_interface {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:26.366739 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:26.371182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a58fc9ec-28c6-49db-a446-63291c010c1c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:26.423611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Pushing event deleted for resources: {'Port': ['ID=bbc8dfae-2d86-42bc-83ae-aa71e1207685,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:26.433632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:26.895759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:27.610961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Router 7a936485-2ecb-4134-b5b5-6475e0f27bda has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:56:27.919798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:56:27.922757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f669065-98db-4f82-936d-33924510dfbd None None] Sync routers for ids ['7a936485-2ecb-4134-b5b5-6475e0f27bda'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:56:27.922757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f669065-98db-4f82-936d-33924510dfbd None None] Routers {'7a936485-2ecb-4134-b5b5-6475e0f27bda'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:27.922757 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-5f669065-98db-4f82-936d-33924510dfbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['7a936485-2ecb-4134-b5b5-6475e0f27bda'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:28.009558 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] 10.222.0.11 "PUT /v2.0/routers/7a936485-2ecb-4134-b5b5-6475e0f27bda/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7785804 Nov 11 11:56:28.010089 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41922) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:28.047738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-5f669065-98db-4f82-936d-33924510dfbd None None] Set router 7a936485-2ecb-4134-b5b5-6475e0f27bda gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:28.256267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks [] for router, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:28.435706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-5f669065-98db-4f82-936d-33924510dfbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:56:26Z', 'revision_number': 5, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:28.441396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f669065-98db-4f82-936d-33924510dfbd None None] Checking router: 7a936485-2ecb-4134-b5b5-6475e0f27bda for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:56:28.469117 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f669065-98db-4f82-936d-33924510dfbd None None] Routers {'7a936485-2ecb-4134-b5b5-6475e0f27bda'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:28.469962 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-5f669065-98db-4f82-936d-33924510dfbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['7a936485-2ecb-4134-b5b5-6475e0f27bda'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:28.706992 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-5f669065-98db-4f82-936d-33924510dfbd None None] Set router 7a936485-2ecb-4134-b5b5-6475e0f27bda gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:28.868410 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:28.908516 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Deleting port 00cdaa72-3172-499d-8f32-783bc7f2ee2d {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:28.908904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:29.066249 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-5f669065-98db-4f82-936d-33924510dfbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:56:26Z', 'revision_number': 5, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:29.071268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f669065-98db-4f82-936d-33924510dfbd None None] The sync data for ids ['7a936485-2ecb-4134-b5b5-6475e0f27bda'] in dv-cinder-817417-1-iscsi is: [{'id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'name': 'tempest-TestMinimumBasicScenario-1102472099-router', 'tenant_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89'}], 'enable_snat': True}, 'gw_port_id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:52:21Z', 'updated_at': '2021-11-11T11:56:26Z', 'revision_number': 5, 'project_id': '70fe58003dfc4c6e90cc8f7f1ec717bc', 'gw_port': {'id': '00cdaa72-3172-499d-8f32-783bc7f2ee2d', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:64:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a936485-2ecb-4134-b5b5-6475e0f27bda', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:52:22Z', 'updated_at': '2021-11-11T11:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:56:29.215222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] For port 00cdaa72-3172-499d-8f32-783bc7f2ee2d, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=00cdaa72-3172-499d-8f32-783bc7f2ee2d,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:29.215657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:29.404190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Calling delete_port for 00cdaa72-3172-499d-8f32-783bc7f2ee2d owned by network:router_gateway {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:29.686061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:29.691449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-83a42c6f-7196-42be-a088-c3b20ec702ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:29.749286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Pushing event deleted for resources: {'Port': ['ID=00cdaa72-3172-499d-8f32-783bc7f2ee2d,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:29.755266 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:30.099320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:30.402355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:30.409573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:30.686286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:30.687748 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7a936485-2ecb-4134-b5b5-6475e0f27bda {{(pid=88328) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 11:56:30.714589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:30.722077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41942) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:30.736135 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] 10.222.0.11 "DELETE /v2.0/routers/7a936485-2ecb-4134-b5b5-6475e0f27bda HTTP/1.1" status: 204 len: 168 time: 2.7245841 Nov 11 11:56:30.859667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Deleting subnet 4b9f6aa6-3f4b-453e-be0f-e3a7a1709027 {{(pid=88329) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:56:30.869717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:30.956523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device bbc8dfae-2d86-42bc-83ae-aa71e1207685 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:56:30.967028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852055773'] for subnet, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:31.016199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: bbc8dfae-2d86-42bc-83ae-aa71e1207685 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:56:31.016716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device bbc8dfae-2d86-42bc-83ae-aa71e1207685 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:56:31.063718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:31.423278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852055754', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036852017038'] for subnet, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:31.429808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:31.482196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b9f6aa6-3f4b-453e-be0f-e3a7a1709027,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:31.495227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:31.496155 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-267782c7-def1-48a8-adbc-27d7ce85da2c None None] Network 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:56:31.506879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41954) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:31.507110 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/4b9f6aa6-3f4b-453e-be0f-e3a7a1709027 HTTP/1.1" status: 204 len: 168 time: 0.7832215 Nov 11 11:56:31.513627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.513627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.513627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.513627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.513627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.514618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.514618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.514618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.515088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.515541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.515893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:31.519785 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:31.706446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:31.724464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Deleting port 7ccfa3dd-974b-4a20-adf7-40f06931d700 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:31.724740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:32.135411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] For port 7ccfa3dd-974b-4a20-adf7-40f06931d700, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=7ccfa3dd-974b-4a20-adf7-40f06931d700,segment=NetworkSegment(182819e1-eced-44cf-a263-baf3680de8cd),segment_id=182819e1-eced-44cf-a263-baf3680de8cd)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:32.135411 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:32.193483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] DHCP port deletion for 3cb5b798-18d5-4595-82ee-1dd6b771d7c6 request from dv-cinder-817417-1-iscsi {{(pid=88330) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:247}} Nov 11 11:56:32.198394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] Deleting port 7ccfa3dd-974b-4a20-adf7-40f06931d700 {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:32.199140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:32.207130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Calling delete_port for 7ccfa3dd-974b-4a20-adf7-40f06931d700 owned by network:dhcp {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:32.479753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] For port 7ccfa3dd-974b-4a20-adf7-40f06931d700, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=7ccfa3dd-974b-4a20-adf7-40f06931d700,segment=NetworkSegment(182819e1-eced-44cf-a263-baf3680de8cd),segment_id=182819e1-eced-44cf-a263-baf3680de8cd)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:32.479753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:32.583216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] Calling delete_port for 7ccfa3dd-974b-4a20-adf7-40f06931d700 owned by network:dhcp {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:56:32.676610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 11:56:32.677189 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 11:56:32.776077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:32.784455 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-896f5037-a370-4986-b810-fb64cd1355c7 tempest-AttachVolumeShelveTestJSON-163049804 tempest-AttachVolumeShelveTestJSON-163049804-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:32.844108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Pushing event deleted for resources: {'Port': ['ID=7ccfa3dd-974b-4a20-adf7-40f06931d700,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:32.853302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:32.859612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] No DVR routers for this DVR port 7ccfa3dd-974b-4a20-adf7-40f06931d700 on host dv-cinder-817417-1-iscsi {{(pid=88328) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:56:32.929882 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 00cdaa72-3172-499d-8f32-783bc7f2ee2d no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:56:33.013358 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 00cdaa72-3172-499d-8f32-783bc7f2ee2d {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:56:33.014533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 00cdaa72-3172-499d-8f32-783bc7f2ee2d not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:56:33.015738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 7ccfa3dd-974b-4a20-adf7-40f06931d700 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:56:33.040287 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:33.071247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3cb5b798-18d5-4595-82ee-1dd6b771d7c6']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:33.082077 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 7ccfa3dd-974b-4a20-adf7-40f06931d700 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:56:33.082968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 7ccfa3dd-974b-4a20-adf7-40f06931d700 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:56:33.086758 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '182819e1-eced-44cf-a263-baf3680de8cd') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:33.087101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '182819e1-eced-44cf-a263-baf3680de8cd') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:33.101747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:33.178517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] Deleting port 7ccfa3dd-974b-4a20-adf7-40f06931d700 {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:56:33.179037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:33.234576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:33.248857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Releasing vlan 1012 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:56:33.249549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:33.262226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-ffaf3911-6993-4554-be1c-d8a6dc435da3 None None] The port '7ccfa3dd-974b-4a20-adf7-40f06931d700' was deleted {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1877}} Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:56:33.267756 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:56:33.480891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:33.489008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:33.510479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:33.514144 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Pushing event deleted for resources: {'Network': ['ID=3cb5b798-18d5-4595-82ee-1dd6b771d7c6,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:33.520678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:33.529028 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-df5178cd-b635-4ea8-bfe4-ae0ed3611f09 admin admin] 10.222.0.11 "DELETE /v2.0/networks/3cb5b798-18d5-4595-82ee-1dd6b771d7c6 HTTP/1.1" status: 204 len: 168 time: 2.0208666 Nov 11 11:56:33.823851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41968) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:33.894738 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b886669a-560e-42b4-815f-42767bdc0598 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=08033101aa064f2da647814019558d4e&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0694928 Nov 11 11:56:33.897494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41972) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:33.993665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb43293e-f3f7-4140-9ab0-16f12b7b1150 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:34.026711 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb43293e-f3f7-4140-9ab0-16f12b7b1150 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:34.371253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb43293e-f3f7-4140-9ab0-16f12b7b1150 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:34.376264 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5b4aa849-2ead-4f78-afb7-1159e1d8f0ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:34.392536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb43293e-f3f7-4140-9ab0-16f12b7b1150 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=091599ea-1d12-4fa6-b21a-4de8f0f3d035,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:34.396272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cb43293e-f3f7-4140-9ab0-16f12b7b1150 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:34.404669 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cb43293e-f3f7-4140-9ab0-16f12b7b1150 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:34.404669 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cb43293e-f3f7-4140-9ab0-16f12b7b1150 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/091599ea-1d12-4fa6-b21a-4de8f0f3d035 HTTP/1.1" status: 204 len: 168 time: 0.5028548 Nov 11 11:56:34.790405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:35.050494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 41988) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:35.110819 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-7ef23cc7-3dd8-4d73-9dc0-829c3f544cbc admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=70fe58003dfc4c6e90cc8f7f1ec717bc&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0588279 Nov 11 11:56:35.111485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 41992) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:35.195055 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-04ddf7a2-974f-4ce0-884a-649edd3a113b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:35.232969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-04ddf7a2-974f-4ce0-884a-649edd3a113b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:35.383824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-04ddf7a2-974f-4ce0-884a-649edd3a113b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:35.388786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cb43293e-f3f7-4140-9ab0-16f12b7b1150 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:35.402630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ddf7a2-974f-4ce0-884a-649edd3a113b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73c980e6-4b2d-4c40-9844-f9a5b1727ecc,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:35.405819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-04ddf7a2-974f-4ce0-884a-649edd3a113b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:35.426356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-04ddf7a2-974f-4ce0-884a-649edd3a113b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:35.427935 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-04ddf7a2-974f-4ce0-884a-649edd3a113b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/73c980e6-4b2d-4c40-9844-f9a5b1727ecc HTTP/1.1" status: 204 len: 168 time: 0.3153021 Nov 11 11:56:36.930963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42022) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:37.100969 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-525025880-network', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:37.107851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:37.114911 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Usage tracker for resource:network and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:37.118698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:37.125531 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:37.264517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Made reservation on behalf of 5d0ef0fa307d43119524263d91d2b2e4 for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:56:37.269729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:37.296428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:37.405153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:37.409146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Usage tracker for resource:security_group_rule and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:37.413317 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:37.419924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:37.490491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:37.521298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:37.526561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cd8f2555-c3da-43bd-924f-3b7ac724351c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:37.554394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1031} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:56:37.568906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ac74602-8ac2-4e50-a2b4-57fbd015296b,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:37.572973 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:37.577364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:37.580657 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Added segment f9defc44-85fd-41dc-bbc4-4667ef350570 of type vlan for network 5d525e47-392a-4037-a12e-ef51f3af2313 Nov 11 11:56:37.612907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:37.704741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:37.705759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:37.706404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:37.712352 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:37.825893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Pushing event updated for resources: {'Network': ['ID=5d525e47-392a-4037-a12e-ef51f3af2313,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:37.830257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:37.843184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 5d525e47-392a-4037-a12e-ef51f3af2313 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:56:37.859246 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9263065 Nov 11 11:56:37.862178 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42036) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:37.869288 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Request body: {'subnet': {'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-525025880-subnet', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:37.876171 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:37.881755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Usage tracker for resource:subnet and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:37.886056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:37.897828 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:37.942996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Made reservation on behalf of 5d0ef0fa307d43119524263d91d2b2e4 for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:56:37.948610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036852136936'] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:38.252122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created--9223372036852097580', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036852136951'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:38.257450 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b10f64cf-3451-40d1-b4f9-799e8d619303 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:38.339869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b56fb566-0eb1-4687-8b21-11f7dabfd9bd,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:38.342885 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:38.358533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Checking segment: {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:38.358936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Network hostable DHCP agents. Network: 5d525e47-392a-4037-a12e-ef51f3af2313, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:56:38.418518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Network 5d525e47-392a-4037-a12e-ef51f3af2313 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:56:38.451891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 5d525e47-392a-4037-a12e-ef51f3af2313) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:38.457071 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:38.458198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:38.461985 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e87717e-1201-49d9-a4ad-566230d5df3a None None] Network 5d525e47-392a-4037-a12e-ef51f3af2313 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:56:38.509656 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6e903a87-6b1c-401b-ae4b-75405a7ee9c1 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.6459711 Nov 11 11:56:38.512753 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42046) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:38.519565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:38.525200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:38.529993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Usage tracker for resource:router and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:38.533593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:38.540276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:38.623091 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:38.624364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:38.653073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:38.710201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-5d525e47-392a-4037-a12e-ef51f3af2313', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:56:38.711120 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:38.855466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:38.919543 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Allocated IP 172.20.0.2 (5d525e47-392a-4037-a12e-ef51f3af2313/b56fb566-0eb1-4687-8b21-11f7dabfd9bd/3bc6a648-9d91-45a5-83cd-b2ce30636a57) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:56:39.097613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.130760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.151072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.164462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Transition to ACTIVE for port object 3bc6a648-9d91-45a5-83cd-b2ce30636a57 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:39.188342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Transition to ACTIVE for port object 3bc6a648-9d91-45a5-83cd-b2ce30636a57 will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:39.247819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.257818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-feea2054-7dea-4a2a-a3c1-594b6a486f61 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:39.332460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Network 5d525e47-392a-4037-a12e-ef51f3af2313 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:39.336582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Pushing event updated for resources: {'Port': ['ID=3bc6a648-9d91-45a5-83cd-b2ce30636a57,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:39.339449 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:39.341501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:39.342333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:56:39.440690 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Attempting to bind port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:56:39.441033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Attempting to bind port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:56:39.441440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Attempting to bind port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 on network 5d525e47-392a-4037-a12e-ef51f3af2313 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:56:39.449161 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 56, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:56:39.449587 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Checking segment: {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:39.450051 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.450498 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Bound using segment: {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:56:39.451082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Bound port: 3bc6a648-9d91-45a5-83cd-b2ce30636a57, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:56:39.452135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.536545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Allocated IP 172.27.3.85 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/97c1209a-045f-401b-8e15-472f1348cee1) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:56:39.593430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] For port 3bc6a648-9d91-45a5-83cd-b2ce30636a57, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:56:39.649324 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] For port 3bc6a648-9d91-45a5-83cd-b2ce30636a57, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=3bc6a648-9d91-45a5-83cd-b2ce30636a57,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:56:39.688573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.697580 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:39.791050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Pushing event updated for resources: {'Port': ['ID=3bc6a648-9d91-45a5-83cd-b2ce30636a57,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:39.797795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:39.831693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.893712 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:39.899722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-99463002-e2ee-4472-ba04-e738caddd140 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:39.962388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:39.965497 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:39.973033 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:56:40.031606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-118492b2-8dc1-4cc1-9241-355c08f53f84 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:40.047876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Pushing event updated for resources: {'Port': ['ID=97c1209a-045f-401b-8e15-472f1348cee1,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:40.053020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:40.266912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:40.268470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:40.606103 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88328) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:56:40.885396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:56:40.903535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Sync routers for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:56:40.923925 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:40.925098 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:40.949579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:40.952160 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ffa9db28-6797-49c2-8a75-632965d5cb0d admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.4376173 Nov 11 11:56:40.956759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42100) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:41.045895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 3bc6a648-9d91-45a5-83cd-b2ce30636a57 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:41.333245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:41.378178 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:41.451864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:41.797912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4af14ac8-2d18-49e6-9199-b519764baa1e None None] Network 5d525e47-392a-4037-a12e-ef51f3af2313 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:56:42.028095 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-31151f6c-e9a3-44d2-9ab7-959dbc83e6f1 None None] Provisioning for port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:42.081408 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-31151f6c-e9a3-44d2-9ab7-959dbc83e6f1 None None] Provisioning complete for port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:42.081841 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31151f6c-e9a3-44d2-9ab7-959dbc83e6f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.085393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.204970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:40Z', 'revision_number': 3, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:42.227657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Checking router: 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:56:42.228625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Updating router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 port 97c1209a-045f-401b-8e15-472f1348cee1 binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:56:42.339280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Allocated IP 172.20.0.1 (5d525e47-392a-4037-a12e-ef51f3af2313/b56fb566-0eb1-4687-8b21-11f7dabfd9bd/f2262ce2-cfd5-400f-a206-fd5513909749) {{(pid=88328) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:56:42.381542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.418011 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31151f6c-e9a3-44d2-9ab7-959dbc83e6f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.514939 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify callbacks [] for port, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.538014 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Transition to ACTIVE for port object f2262ce2-cfd5-400f-a206-fd5513909749 will not be triggered until provisioned by entity DHCP. {{(pid=88328) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:42.544903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-31151f6c-e9a3-44d2-9ab7-959dbc83e6f1 None None] For port 3bc6a648-9d91-45a5-83cd-b2ce30636a57, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=3bc6a648-9d91-45a5-83cd-b2ce30636a57,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:42.594311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-31151f6c-e9a3-44d2-9ab7-959dbc83e6f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.599825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:42.625288 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:56:42.628316 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.636791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-eb439142-c9d1-435b-9f7d-e204e71945b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:42.711384 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Network 5d525e47-392a-4037-a12e-ef51f3af2313 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:42.720865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:42.726609 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Received port after_create {{(pid=88328) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:56:42.772413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31151f6c-e9a3-44d2-9ab7-959dbc83e6f1 None None] Pushing event updated for resources: {'Port': ['ID=3bc6a648-9d91-45a5-83cd-b2ce30636a57,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:42.776705 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-31151f6c-e9a3-44d2-9ab7-959dbc83e6f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:42.799421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Pushing event updated for resources: {'Port': ['ID=f2262ce2-cfd5-400f-a206-fd5513909749,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:42.804142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:42.809324 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.881829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e7a9993a-6721-4922-ab52-4e8eb95b2fb7 None None] Provisioning complete for port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:42.881829 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e7a9993a-6721-4922-ab52-4e8eb95b2fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:42.932388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 3bc6a648-9d91-45a5-83cd-b2ce30636a57 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:42.970520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.030380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.070795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Transition to ACTIVE for port object 97c1209a-045f-401b-8e15-472f1348cee1 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:43.108475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42122) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:43.114290 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.125612 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:43.197533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] Deleting subnet 366275ac-3cf8-41a5-a3b7-ba8870dbc4a6 {{(pid=88329) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:56:43.205190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.247703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa1fd0e9-f837-4d99-94ae-e99bf81bcb31 None None] Pushing event updated for resources: {'Port': ['ID=97c1209a-045f-401b-8e15-472f1348cee1,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:43.250863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:43.250863 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.272957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852055773'] for subnet, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.275842 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Attempting to bind port 97c1209a-045f-401b-8e15-472f1348cee1 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:56:43.276285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Attempting to bind port 97c1209a-045f-401b-8e15-472f1348cee1 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:56:43.277028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Attempting to bind port 97c1209a-045f-401b-8e15-472f1348cee1 on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:56:43.279367 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fa1fd0e9-f837-4d99-94ae-e99bf81bcb31 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:43.302781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 56, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:56:43.303346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:43.303895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.304425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:56:43.305035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Bound port: 97c1209a-045f-401b-8e15-472f1348cee1, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:56:43.305544 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.316570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify callbacks [] for port, precommit_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.342234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.356879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2678119'] for port, after_update {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.388692 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5193a85d-a87a-4495-97b8-346efc6fe1ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:43.466491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852055754', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036852017038'] for subnet, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.472713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-68a3ee84-2580-49da-8c82-fa2e756c6166 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:43.482835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e3e18770-ff4e-47b6-bbab-65a654f45b24 None None] Provisioning for port f2262ce2-cfd5-400f-a206-fd5513909749 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:43.485206 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.490069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] For port 97c1209a-045f-401b-8e15-472f1348cee1, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:56:43.511239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Pushing event updated for resources: {'Port': ['ID=f2262ce2-cfd5-400f-a206-fd5513909749,revision_number=2']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:43.515502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-e3e18770-ff4e-47b6-bbab-65a654f45b24 None None] Provisioning complete for port f2262ce2-cfd5-400f-a206-fd5513909749 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:43.515964 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e3e18770-ff4e-47b6-bbab-65a654f45b24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.527433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:43.535950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=366275ac-3cf8-41a5-a3b7-ba8870dbc4a6,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:43.539112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.549297 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/366275ac-3cf8-41a5-a3b7-ba8870dbc4a6 HTTP/1.1" status: 204 len: 168 time: 0.4379754 Nov 11 11:56:43.550401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-302f73b2-a00b-42a0-b0b0-7b7370f89402 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:43.551333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42126) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:43.569618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] For port 97c1209a-045f-401b-8e15-472f1348cee1, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=97c1209a-045f-401b-8e15-472f1348cee1,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:56:43.598070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.605596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-05bbb619-5ffb-4ef5-bf44-a46b4d942e6c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:43.647298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.648058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-e3e18770-ff4e-47b6-bbab-65a654f45b24 None None] Port f2262ce2-cfd5-400f-a206-fd5513909749 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:56:43.649734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4eba94db-0ed0-4132-b4f2-b6b2c729d758 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.681026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.699096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa1fd0e9-f837-4d99-94ae-e99bf81bcb31 None None] Pushing event updated for resources: {'Port': ['ID=97c1209a-045f-401b-8e15-472f1348cee1,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:43.704600 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fa1fd0e9-f837-4d99-94ae-e99bf81bcb31 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:43.709028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:43.709729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:43.852941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.884400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aef5a8ae-7e84-4add-82f9-2bcffa7c563b']}} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:43.899344 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '759b06c7-8439-45c2-977b-f3cad3321ad8') {'for_net_delete': True} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:43.899782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '759b06c7-8439-45c2-977b-f3cad3321ad8') {} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:43.913644 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2720042'] for segment, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.926097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Network 5d525e47-392a-4037-a12e-ef51f3af2313 is already hosted by enough agents. {{(pid=88328) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:43.927455 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Resources bound (agent type, host, resource id): {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:43.929067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:43.929890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.938548 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Releasing vlan 1004 on physical network physnet1 to pool {{(pid=88329) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:56:43.939079 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2720660'] for segment, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:56:43.954945 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:56:44.093869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:44.098406 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:44.120368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Pushing event deleted for resources: {'Network': ['ID=aef5a8ae-7e84-4add-82f9-2bcffa7c563b,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:44.122638 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:44.126485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:44.134226 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-23137774-a374-460f-941b-f2c23da8a4af admin admin] 10.222.0.11 "DELETE /v2.0/networks/aef5a8ae-7e84-4add-82f9-2bcffa7c563b HTTP/1.1" status: 204 len: 168 time: 0.5814502 Nov 11 11:56:44.387847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-0ac7f5ac-98a2-43a3-8a34-d5e004636447 None None] Provisioning complete for port f2262ce2-cfd5-400f-a206-fd5513909749 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:44.388355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0ac7f5ac-98a2-43a3-8a34-d5e004636447 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:44.410016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42132) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:44.433263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:56:44.470648 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-37a07869-dd1a-491d-8e9a-b4eda2cce2b0 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2942609a1bb4440b9e6bdb1e669bbd81&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0592201 Nov 11 11:56:44.473311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42136) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:44.502732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-0ac7f5ac-98a2-43a3-8a34-d5e004636447 None None] Port f2262ce2-cfd5-400f-a206-fd5513909749 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:56:44.555667 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d4534807-af0a-45dc-8c69-c3b0dd3c0447 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:44.557293 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-01e8c465-321f-4437-91db-4078822dc14f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:43Z', 'revision_number': 2, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:44.562968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e8c465-321f-4437-91db-4078822dc14f None None] The sync data for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi is: [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:43Z', 'revision_number': 2, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:56:44.591006 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d4534807-af0a-45dc-8c69-c3b0dd3c0447 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:44.673737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:56:44.683621 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-220f76fb-ee1e-41f0-8706-d7167120219b admin admin] 10.222.0.11 "PUT /v2.0/routers/232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7255106 Nov 11 11:56:44.721037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:44.795188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d4534807-af0a-45dc-8c69-c3b0dd3c0447 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:44.801517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-25f50123-b2a5-4009-b7dd-9229b2c36fc3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:44.814903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4534807-af0a-45dc-8c69-c3b0dd3c0447 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=387b162c-a83f-4d10-92de-efa38ad49aab,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:44.818230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d4534807-af0a-45dc-8c69-c3b0dd3c0447 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:44.820395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d4534807-af0a-45dc-8c69-c3b0dd3c0447 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:44.826314 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d4534807-af0a-45dc-8c69-c3b0dd3c0447 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/387b162c-a83f-4d10-92de-efa38ad49aab HTTP/1.1" status: 204 len: 168 time: 0.3492575 Nov 11 11:56:46.059650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42176) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:46.067765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-585402478-network', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:46.073776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:46.078594 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Usage tracker for resource:network and tenant:c129fc4304924d1cbaff9412e4c54ebe is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:46.082487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:46.089404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:46.128721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Made reservation on behalf of c129fc4304924d1cbaff9412e4c54ebe for: {'network': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:56:46.134060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.138291 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42180) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:46.152822 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.191068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:46.195820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Usage tracker for resource:security_group_rule and tenant:c129fc4304924d1cbaff9412e4c54ebe is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:46.199137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:46.205810 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:46.285908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.300999 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1652251119-network', 'tenant_id': '43c0382884ff4a219b96f50bc6fb1e32'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:46.306190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:46.310421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Usage tracker for resource:network and tenant:43c0382884ff4a219b96f50bc6fb1e32 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:46.313538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:46.319767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:46.327682 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.332647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ba471c1f-4e28-440a-ad79-55f11ce3a8eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:46.360311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1007} {{(pid=88329) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:56:46.363018 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Made reservation on behalf of 43c0382884ff4a219b96f50bc6fb1e32 for: {'network': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:56:46.370038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for network, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.374774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bff7fd11-dda7-4536-be07-75cb430ad6b9,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:46.378134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:46.395773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.433927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.434439 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Added segment 9a1d0522-cde2-430d-be8b-2969439679f0 of type vlan for network 53517e7f-50da-4273-ad84-f2e9aaa53e29 Nov 11 11:56:46.446815 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:46.451439 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Usage tracker for resource:security_group_rule and tenant:43c0382884ff4a219b96f50bc6fb1e32 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:46.455345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:46.462107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:46.468983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.542044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.545196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.546559 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:46.547228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.552906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:46.573122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.579558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-656e8f05-5029-4090-92d7-cafbf4dcc1fc tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:46.616716 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1009} {{(pid=88328) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:154}} Nov 11 11:56:46.630632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae210d10-c10a-4a78-ba88-e4f7261ed5b7,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:46.634111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:46.638584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.639031 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.segments_db [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Added segment 588e590a-28f1-4341-aa2d-7001b9630355 of type vlan for network 573e3e39-f87a-4728-9797-ba0f2cdaf07a Nov 11 11:56:46.668102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Pushing event updated for resources: {'Network': ['ID=53517e7f-50da-4273-ad84-f2e9aaa53e29,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:46.671008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731490076087'] for network, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.671756 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:46.680200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 53517e7f-50da-4273-ad84-f2e9aaa53e29 details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:56:46.717034 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-89844e49-30a7-4d44-a729-f2d063533110 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6558805 Nov 11 11:56:46.720466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42186) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:46.731407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Request body: {'subnet': {'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-585402478-subnet', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'ip_version': 4}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:46.731839 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:46.736117 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Usage tracker for resource:subnet and tenant:c129fc4304924d1cbaff9412e4c54ebe is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:46.739327 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:46.745948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:46.789635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Made reservation on behalf of c129fc4304924d1cbaff9412e4c54ebe for: {'subnet': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:56:46.794972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2758763'] for subnet, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.815039 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939'] for network, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.816239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:46.816928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:46.822558 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9dcadb48-b02c-4637-ad6b-86558b280e5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:46.942983 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Pushing event updated for resources: {'Network': ['ID=573e3e39-f87a-4728-9797-ba0f2cdaf07a,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:46.946560 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:46.951977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 97c1209a-045f-401b-8e15-472f1348cee1 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:46.959329 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-10b86bec-3a8c-4038-b650-e760944838b7 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.8193212 Nov 11 11:56:46.962929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42190) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:46.970336 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Request body: {'subnet': {'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1652251119-subnet', 'tenant_id': '43c0382884ff4a219b96f50bc6fb1e32', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:46.976967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:46.982820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Usage tracker for resource:subnet and tenant:43c0382884ff4a219b96f50bc6fb1e32 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:46.983000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Network 573e3e39-f87a-4728-9797-ba0f2cdaf07a details requested by agent ovs-agent-dv-cinder-817417-1-iscsi with host dv-cinder-817417-1-iscsi {{(pid=88330) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Nov 11 11:56:46.987503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:46.998240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:47.037060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Made reservation on behalf of 43c0382884ff4a219b96f50bc6fb1e32 for: {'subnet': 1} {{(pid=88328) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:56:47.043907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036852136936'] for subnet, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.095622 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2720250', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2758778'] for subnet, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.101272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:47.157340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 97c1209a-045f-401b-8e15-472f1348cee1 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:47.162645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 97c1209a-045f-401b-8e15-472f1348cee1 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:47.163070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.181819 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Pushing event updated for resources: {'Subnet': ['ID=50f53655-b92a-4474-aa2b-0dbd51fe9929,revision_number=0']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:47.184994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:47.195185 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Checking segment: {'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:47.195681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Network hostable DHCP agents. Network: 53517e7f-50da-4273-ad84-f2e9aaa53e29, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88329) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:56:47.242749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Network 53517e7f-50da-4273-ad84-f2e9aaa53e29 is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88329) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:56:47.276939 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 53517e7f-50da-4273-ad84-f2e9aaa53e29) {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:47.282111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:47.282808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.290879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-910e1026-35c1-474e-9598-551f0dc8412e None None] Network 53517e7f-50da-4273-ad84-f2e9aaa53e29 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:56:47.311326 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.322937 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created--9223372036852097580', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036852136951'] for subnet, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.328306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d192a5ee-64e5-4f93-bfc0-fc5a62464370 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:47.352284 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-022a4fa7-3d96-4f76-9dfe-368b5d28338b admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.6306131 Nov 11 11:56:47.354849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42194) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:47.361303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:47.366334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:47.370542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Usage tracker for resource:router and tenant:c129fc4304924d1cbaff9412e4c54ebe is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:47.373665 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:47.379933 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:47.401713 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 97c1209a-045f-401b-8e15-472f1348cee1, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=97c1209a-045f-401b-8e15-472f1348cee1,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:47.404059 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Pushing event updated for resources: {'Subnet': ['ID=cc8dffe4-8474-48ed-be47-5f9462fe407d,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:47.408926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:47.418183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Checking segment: {'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88328) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:47.418666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Network hostable DHCP agents. Network: 573e3e39-f87a-4728-9797-ba0f2cdaf07a, hostable agents: ['a248c6a0-e7d1-4355-9a8f-74c0d4164c12'], hosted agents: [] {{(pid=88328) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Nov 11 11:56:47.420225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create--9223372036850884690', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request--9223372036854733103'] for router, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.421335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3890956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036850736520', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-4030715', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-42697'] for router, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.442050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.479689 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.481371 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Network 573e3e39-f87a-4728-9797-ba0f2cdaf07a is scheduled to be hosted by DHCP agent a248c6a0-e7d1-4355-9a8f-74c0d4164c12 with binding_index 1 {{(pid=88328) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Nov 11 11:56:47.489197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fa1fd0e9-f837-4d99-94ae-e99bf81bcb31 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:47.546997 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-817417-1-iscsi, 573e3e39-f87a-4728-9797-ba0f2cdaf07a) {{(pid=88328) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:47.553460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=88328) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:47.554850 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.564542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-713625d9-bcd3-45f2-a0c9-3a376c3e965b None None] Network 573e3e39-f87a-4728-9797-ba0f2cdaf07a requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:56:47.621730 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-460b6480-44bd-43dd-bc94-56c417de342d admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6573989 Nov 11 11:56:47.625678 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=97c1209a-045f-401b-8e15-472f1348cee1,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:47.692310 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036850736567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036850884673', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-42744'] for router, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:47.743426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.743800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.744374 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.744910 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.745470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.746028 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.746404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.746782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.747173 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.747565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.747945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:47.753525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:47.758419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpea32d0ae-6def-5183-be53-9d4be9a6d1e8-53517e7f-50da-4273-ad84-f2e9aaa53e29', 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'fixed_ips': [{'subnet_id': '50f53655-b92a-4474-aa2b-0dbd51fe9929'}]}} from dv-cinder-817417-1-iscsi. {{(pid=88330) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Nov 11 11:56:47.759666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:48.077927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f4070e5-657a-4668-b3b8-0d32b5917836 None None] Network 573e3e39-f87a-4728-9797-ba0f2cdaf07a requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:56:48.093257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Allocated IP 172.20.0.2 (53517e7f-50da-4273-ad84-f2e9aaa53e29/50f53655-b92a-4474-aa2b-0dbd51fe9929/36390c35-87ff-46ee-9e5a-1f4c2b065fe5) {{(pid=88330) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:56:48.163774 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:48.224370 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:48.386429 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Allocated IP 172.27.3.41 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/7593b896-fda8-486e-851e-df431a45d2fe) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:56:48.565590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Notify callbacks [] for port, precommit_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:48.591801 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Transition to ACTIVE for port object 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:48.602106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:48.621839 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Transition to ACTIVE for port object 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 will not be triggered until provisioned by entity DHCP. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:48.666479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312'] for port, after_create {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:48.676137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:48.697294 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:48.704484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Sync routers for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:56:48.708328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1f830a8d-d214-4b50-88c0-245fddb6692c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:48.721804 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:48.722485 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:48.739368 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Network 53517e7f-50da-4273-ad84-f2e9aaa53e29 is already hosted by enough agents. {{(pid=88330) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:48.742984 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Resources bound (agent type, host, resource id): {{(pid=88330) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:48.752891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Received port after_create {{(pid=88330) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:56:48.766896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Pushing event updated for resources: {'Port': ['ID=36390c35-87ff-46ee-9e5a-1f4c2b065fe5,revision_number=1']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:48.770707 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:48.826570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:48.834554 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:48.843781 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Pushing event updated for resources: {'Port': ['ID=7593b896-fda8-486e-851e-df431a45d2fe,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:48.848195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:56:48.901803 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:48.927923 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Attempting to bind port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:56:48.928412 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Attempting to bind port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:56:48.928916 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Attempting to bind port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 on network 53517e7f-50da-4273-ad84-f2e9aaa53e29 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:56:48.944308 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 56, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:56:48.944918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Checking segment: {'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:48.945530 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:48.946137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Bound using segment: {'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:56:48.946826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Bound port: 36390c35-87ff-46ee-9e5a-1f4c2b065fe5, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:56:48.947446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:49.005216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 97c1209a-045f-401b-8e15-472f1348cee1 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:49.080949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:49.153176 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:49.153873 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3891126', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-4039214'] for router, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:49.286045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] For port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:56:49.292020 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] For port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=36390c35-87ff-46ee-9e5a-1f4c2b065fe5,segment=NetworkSegment(9a1d0522-cde2-430d-be8b-2969439679f0),segment_id=9a1d0522-cde2-430d-be8b-2969439679f0)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:56:49.304000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 97c1209a-045f-401b-8e15-472f1348cee1 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:49.304511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:49.340604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:49.352635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:49.454600 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 is scheduled to L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 with binding_index 1 {{(pid=88329) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:215}} Nov 11 11:56:49.462198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Pushing event updated for resources: {'Port': ['ID=36390c35-87ff-46ee-9e5a-1f4c2b065fe5,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:49.465859 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:49.518460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:43Z', 'revision_number': 2, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:49.523123 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Checking router: 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:56:49.523972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Updating router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 port f2262ce2-cfd5-400f-a206-fd5513909749 binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:56:49.586058 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:49.736327 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:56:49.752281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Sync routers for ids ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:56:49.772755 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Routers {'9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:49.773469 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:49.808238 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Notify callbacks [] for router, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:49.813289 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.4569895 Nov 11 11:56:49.814146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42210) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:50.096994 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Set router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:50.175751 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:50.192928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Transition to ACTIVE for port object f2262ce2-cfd5-400f-a206-fd5513909749 will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:50.232582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:50.244843 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:50.408959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-b9aee854-2be7-460c-8724-86a4c4ba6032 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:50.410674 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-b9aee854-2be7-460c-8724-86a4c4ba6032 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/networks?id=573e3e39-f87a-4728-9797-ba0f2cdaf07a HTTP/1.1" status: 200 len: 814 time: 0.2984912 Nov 11 11:56:50.465846 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-754d8b01-7057-483e-8fe7-a77726c58990 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/quotas/43c0382884ff4a219b96f50bc6fb1e32 HTTP/1.1" status: 200 len: 375 time: 0.0387847 Nov 11 11:56:50.472520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Pushing event updated for resources: {'Port': ['ID=f2262ce2-cfd5-400f-a206-fd5513909749,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:50.493793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '7593b896-fda8-486e-851e-df431a45d2fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T11:56:49Z', 'revision_number': 3, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port': {'id': '7593b896-fda8-486e-851e-df431a45d2fe', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a7:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:48Z', 'updated_at': '2021-11-11T11:56:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:50.501491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Checking router: 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:56:50.501824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Updating router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 port 7593b896-fda8-486e-851e-df431a45d2fe binding host dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:56:50.544787 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.545182 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.545562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.545941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.546356 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.546722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.547093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.547507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.547877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.548240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.548606 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88331) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:56:50.556748 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.312s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:50.584223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:50.586604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Attempting to bind port f2262ce2-cfd5-400f-a206-fd5513909749 on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:56:50.587209 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Attempting to bind port f2262ce2-cfd5-400f-a206-fd5513909749 by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:56:50.587718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Attempting to bind port f2262ce2-cfd5-400f-a206-fd5513909749 on network 5d525e47-392a-4037-a12e-ef51f3af2313 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:56:50.597304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 56, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:56:50.597836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Checking segment: {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:50.598529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:50.599281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Bound using segment: {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:56:50.600101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Bound port: f2262ce2-cfd5-400f-a206-fd5513909749, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:56:50.600627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:50.633015 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-8becebeb-3ed9-4115-a558-44975d765b92 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1596465 Nov 11 11:56:50.712795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] For port f2262ce2-cfd5-400f-a206-fd5513909749, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:56:50.716609 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] For port f2262ce2-cfd5-400f-a206-fd5513909749, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f2262ce2-cfd5-400f-a206-fd5513909749,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:56:50.768227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:50.780350 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-0df3558d-3104-442e-8fb2-0643df338bb9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:50.833343 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-8e0422d7-1b95-41db-9316-5f0890e0e877 service neutron] 10.222.0.11 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1898825 Nov 11 11:56:50.850575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:50.851311 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:51.117918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:51.165508 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:51.180924 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Pushing event updated for resources: {'Port': ['ID=f2262ce2-cfd5-400f-a206-fd5513909749,revision_number=4']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:51.187610 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f777b529-f2be-4acd-a89e-38ea4f35ef7c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.407s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:51.362340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Notify callbacks [] for port, precommit_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:51.380005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Transition to ACTIVE for port object 7593b896-fda8-486e-851e-df431a45d2fe will not be triggered until provisioned by entity L2. {{(pid=88330) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:51.426088 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:51.435018 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:51.491982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:51.541562 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-a6bbe521-4016-43d5-abf7-927313e1103c service neutron] 10.222.0.11 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7004106 Nov 11 11:56:51.541919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e70f1b-0419-48ea-a8b3-c50abc3ea430 None None] Pushing event updated for resources: {'Port': ['ID=7593b896-fda8-486e-851e-df431a45d2fe,revision_number=2']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:51.548967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-27e70f1b-0419-48ea-a8b3-c50abc3ea430 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:51.570106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Attempting to bind port 7593b896-fda8-486e-851e-df431a45d2fe on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:56:51.570348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Attempting to bind port 7593b896-fda8-486e-851e-df431a45d2fe by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:56:51.570758 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Attempting to bind port 7593b896-fda8-486e-851e-df431a45d2fe on network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:56:51.582388 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 56, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:56:51.582823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Checking segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88330) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:51.583319 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:51.583959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Bound using segment: {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'} {{(pid=88330) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:56:51.584517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Bound port: 7593b896-fda8-486e-851e-df431a45d2fe, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23adfd8-0d68-4b14-aea4-d4df5cdbf1da', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5'}}] {{(pid=88330) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:56:51.584957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:51.665428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:50Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:51.673980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0418db0-f61e-486b-ba4b-eda61ac8cde3 None None] The sync data for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi is: [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:50Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:56:51.709097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] For port 7593b896-fda8-486e-851e-df431a45d2fe, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88330) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:56:51.713699 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] For port 7593b896-fda8-486e-851e-df431a45d2fe, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=7593b896-fda8-486e-851e-df431a45d2fe,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:56:51.748437 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:51.758695 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:51.889653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Routers {'9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:51.891048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:52.054024 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c0561d3c-96ff-4f2f-8b79-73a72c5f9edf req-38fe5de1-70c9-4056-ab99-18af1fc3e548 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 210 time: 0.1112514 Nov 11 11:56:52.059495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:52.131393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ccf0719-8189-4d96-87f7-c770d1dc17c6 None None] Network 53517e7f-50da-4273-ad84-f2e9aaa53e29 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 11:56:52.184190 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e70f1b-0419-48ea-a8b3-c50abc3ea430 None None] Pushing event updated for resources: {'Port': ['ID=7593b896-fda8-486e-851e-df431a45d2fe,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:52.195325 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-27e70f1b-0419-48ea-a8b3-c50abc3ea430 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.437s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:52.316639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] Set router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:52.383720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-ec7653d4-ef3f-42b1-862a-69102a8d2a0e None None] Provisioning for port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:52.485793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Allocated IP 172.20.0.1 (53517e7f-50da-4273-ad84-f2e9aaa53e29/50f53655-b92a-4474-aa2b-0dbd51fe9929/cf8e2fcb-c078-437c-bd2e-84f333ba37fc) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:56:52.522807 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-ec7653d4-ef3f-42b1-862a-69102a8d2a0e None None] Provisioning complete for port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:52.523441 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ec7653d4-ef3f-42b1-862a-69102a8d2a0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:52.673681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:52.698275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Transition to ACTIVE for port object cf8e2fcb-c078-437c-bd2e-84f333ba37fc will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:52.793823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:52.801523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-38a47271-7141-4b0c-b6ae-b6aa8a139989 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:52.889735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Network 53517e7f-50da-4273-ad84-f2e9aaa53e29 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:52.896428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:52.902061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:56:52.941955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Pushing event updated for resources: {'Port': ['ID=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:52.948946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:52.975886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036850730645'] for router_interface, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:52.994676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f2262ce2-cfd5-400f-a206-fd5513909749 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:53.184899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ec7653d4-ef3f-42b1-862a-69102a8d2a0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.252490 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-ec7653d4-ef3f-42b1-862a-69102a8d2a0e None None] For port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=36390c35-87ff-46ee-9e5a-1f4c2b065fe5,segment=NetworkSegment(9a1d0522-cde2-430d-be8b-2969439679f0),segment_id=9a1d0522-cde2-430d-be8b-2969439679f0)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:53.262475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '7593b896-fda8-486e-851e-df431a45d2fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T11:56:49Z', 'revision_number': 3, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port': {'id': '7593b896-fda8-486e-851e-df431a45d2fe', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a7:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:48Z', 'updated_at': '2021-11-11T11:56:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:53.267661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ce23c24-c2a9-4a72-9d50-dbcc9e3861cb None None] The sync data for ids ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'] in dv-cinder-817417-1-iscsi is: [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '7593b896-fda8-486e-851e-df431a45d2fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T11:56:49Z', 'revision_number': 3, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port': {'id': '7593b896-fda8-486e-851e-df431a45d2fe', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a7:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:48Z', 'updated_at': '2021-11-11T11:56:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:56:53.316222 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port f2262ce2-cfd5-400f-a206-fd5513909749 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:53.321486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ec7653d4-ef3f-42b1-862a-69102a8d2a0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.323899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fa1fd0e9-f837-4d99-94ae-e99bf81bcb31 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:53.347631 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-956d0ee4-f217-44ef-8f75-5cf118e873bb req-7c027d2b-fc61-46aa-a364-d7ee5764d4cb tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 210 time: 0.1276119 Nov 11 11:56:53.362111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port f2262ce2-cfd5-400f-a206-fd5513909749 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:53.362111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.366793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.487835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec7653d4-ef3f-42b1-862a-69102a8d2a0e None None] Pushing event updated for resources: {'Port': ['ID=36390c35-87ff-46ee-9e5a-1f4c2b065fe5,revision_number=3']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:53.494584 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ec7653d4-ef3f-42b1-862a-69102a8d2a0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:53.585988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.628126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port f2262ce2-cfd5-400f-a206-fd5513909749, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f2262ce2-cfd5-400f-a206-fd5513909749,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:53.666672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.676013 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.679136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-90b47402-d57e-4d9b-8cef-35595504c40d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:53.712279 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.719680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d8a716-69e9-434b-9462-69b963550235 None None] Provisioning for port cf8e2fcb-c078-437c-bd2e-84f333ba37fc completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:53.736879 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d8a716-69e9-434b-9462-69b963550235 None None] Provisioning complete for port cf8e2fcb-c078-437c-bd2e-84f333ba37fc triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:53.737300 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d8a716-69e9-434b-9462-69b963550235 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.747725 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-1ba2573c-904d-4430-884d-a61a345d76c2 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:53.822661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d8a716-69e9-434b-9462-69b963550235 None None] Port cf8e2fcb-c078-437c-bd2e-84f333ba37fc cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:56:53.846896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=f2262ce2-cfd5-400f-a206-fd5513909749,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:53.854085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:53.866211 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created--9223372036851444956', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-4045068'] for router_interface, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.874224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d8a716-69e9-434b-9462-69b963550235 None None] Provisioning complete for port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:53.874795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d8a716-69e9-434b-9462-69b963550235 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:53.879398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Pushing event updated for resources: {'Port': ['ID=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:53.891817 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:54.087096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Network 53517e7f-50da-4273-ad84-f2e9aaa53e29 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:54.088471 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:54.188428 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-3833b18d-5143-43ed-90d6-1c8a48c42422 None None] Provisioning complete for port cf8e2fcb-c078-437c-bd2e-84f333ba37fc triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:54.189198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3833b18d-5143-43ed-90d6-1c8a48c42422 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:54.278906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-3833b18d-5143-43ed-90d6-1c8a48c42422 None None] Port cf8e2fcb-c078-437c-bd2e-84f333ba37fc cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:56:54.525399 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-796d84dd-d6ff-4b08-ba9d-3e925e6a3a2b None None] Provisioning complete for port cf8e2fcb-c078-437c-bd2e-84f333ba37fc triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:54.526000 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-796d84dd-d6ff-4b08-ba9d-3e925e6a3a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:54.610208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-796d84dd-d6ff-4b08-ba9d-3e925e6a3a2b None None] Port cf8e2fcb-c078-437c-bd2e-84f333ba37fc cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:56:54.686633 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ee079472-3aed-4c39-a8e8-4cd87ec38eea req-d74e86ef-9a48-419c-85bd-071315e2534d tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 210 time: 0.0814161 Nov 11 11:56:54.705942 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-0f4d0f4e-2ed3-4526-b6f5-03a3648b75af tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:54.707697 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-0f4d0f4e-2ed3-4526-b6f5-03a3648b75af tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.60 "GET /v2.0/networks?id=573e3e39-f87a-4728-9797-ba0f2cdaf07a HTTP/1.1" status: 200 len: 814 time: 0.3546419 Nov 11 11:56:54.729624 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Request body: {'port': {'device_id': 'f1519220-11ac-4f9a-a744-3f7016e03b44', 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a', 'admin_state_up': True, 'tenant_id': '43c0382884ff4a219b96f50bc6fb1e32'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:54.983083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:54.991130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Usage tracker for resource:port and tenant:43c0382884ff4a219b96f50bc6fb1e32 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:54.994825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:55.004864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:55.025025 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:56:55.039745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 7593b896-fda8-486e-851e-df431a45d2fe up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:55.152338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port 7593b896-fda8-486e-851e-df431a45d2fe completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:56:55.161263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 7593b896-fda8-486e-851e-df431a45d2fe triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:55.161852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:55.305217 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:55.324886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port 7593b896-fda8-486e-851e-df431a45d2fe, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=7593b896-fda8-486e-851e-df431a45d2fe,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:56:55.349770 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Made reservation on behalf of 43c0382884ff4a219b96f50bc6fb1e32 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:56:55.355621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:55.364004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:55.365112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f2262ce2-cfd5-400f-a206-fd5513909749 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:55.394955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:55.496475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=7593b896-fda8-486e-851e-df431a45d2fe,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:55.500993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:55.523019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port f2262ce2-cfd5-400f-a206-fd5513909749 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:55.523019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:55.644515 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Allocated IP 172.20.0.5 (573e3e39-f87a-4728-9797-ba0f2cdaf07a/cc8dffe4-8474-48ed-be47-5f9462fe407d/503f62f7-f533-4766-8da8-7233a950f84a) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:56:55.663273 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:55.749968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:55.751293 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:55.780419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:56:55.913142 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] 10.222.0.11 "PUT /v2.0/routers/9b80a1f9-40a3-4e0a-ac7d-58a8179eb176/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0972784 Nov 11 11:56:55.925503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7712e61d-9474-4361-b7ef-32413dbf94eb req-4a72828f-6f91-4bff-9156-00df35807ae1 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Synchronizing usage tracker for tenant:43c0382884ff4a219b96f50bc6fb1e32 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:56:56.002652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:56.033860 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7712e61d-9474-4361-b7ef-32413dbf94eb req-4a72828f-6f91-4bff-9156-00df35807ae1 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Unset dirty status for tenant:43c0382884ff4a219b96f50bc6fb1e32 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:56:56.035222 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7712e61d-9474-4361-b7ef-32413dbf94eb req-4a72828f-6f91-4bff-9156-00df35807ae1 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 210 time: 0.1823044 Nov 11 11:56:56.072968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:56.080021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:56.165659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Network 573e3e39-f87a-4728-9797-ba0f2cdaf07a is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:56:56.175909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:56:56.181397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:56:56.219900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Pushing event updated for resources: {'Port': ['ID=503f62f7-f533-4766-8da8-7233a950f84a,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:56.229768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:56.254729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:56.255463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:56.311646 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-64b6a2dd-6bee-4ceb-91a5-1e20129455ab tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5890336 Nov 11 11:56:56.410703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Request body: {'port': {'device_id': 'f1519220-11ac-4f9a-a744-3f7016e03b44', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:56.557489 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:56.686232 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42254) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:56.693586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-82402078', 'description': 'tempest-secgroup-smoke-82402078 description', 'project_id': '5d0ef0fa307d43119524263d91d2b2e4'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:56.700881 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:56.705706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:security_group and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:56.709084 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:56.718775 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:56.764240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:56.814656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:56.819848 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:security_group_rule and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:56.823686 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:56.831536 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:56.901888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:56.935348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:56.943645 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-552979c4-81cb-418a-85e8-cdf9cabd9dfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:56.962101 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 7593b896-fda8-486e-851e-df431a45d2fe up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:56:57.000657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 503f62f7-f533-4766-8da8-7233a950f84a {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:56:57.008602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.022616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1e86761f-1782-4ce0-a464-16c1324e3cbe,revision_number=1']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:57.028041 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Transition to ACTIVE for port object 503f62f7-f533-4766-8da8-7233a950f84a will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:57.028268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:57.038227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.038944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Sync routers for ids ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:56:57.040102 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1624 time: 0.3522160 Nov 11 11:56:57.043832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42258) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:57.052550 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'security_group_rule': {'security_group_id': '1e86761f-1782-4ce0-a464-16c1324e3cbe', 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:57.060478 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Routers {'9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:57.061552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:57.063637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:57.071359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.073065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:security_group_rule and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:57.076582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:57.083766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port 7593b896-fda8-486e-851e-df431a45d2fe triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:56:57.084153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.084545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:57.090448 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ce6335ce-bff6-4307-92fe-8d3bd9c30222 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:57.155618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.262818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.299760 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Pushing event updated for resources: {'Port': ['ID=503f62f7-f533-4766-8da8-7233a950f84a,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:57.299963 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.304571 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:57.304798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:57.334292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f58c3d42-ae87-4448-bcac-8150340b049c,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:57.335068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Set router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:56:57.339704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:57.382062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.384032 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c13240d0-c4f1-43af-a99d-29f0253dc4f3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.3383269 Nov 11 11:56:57.387380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42264) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:57.400640 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'security_group_rule': {'security_group_id': '1e86761f-1782-4ce0-a464-16c1324e3cbe', 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:57.413641 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:57.421944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:security_group_rule and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:57.428188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:57.439198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:57.445236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc2a4d7-7021-4dd7-b628-4fa71b51c4c7 req-b45d7d6c-1232-4bb9-ba83-e1b7120da7b4 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:57.446952 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1fc2a4d7-7021-4dd7-b628-4fa71b51c4c7 req-b45d7d6c-1232-4bb9-ba83-e1b7120da7b4 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 943 time: 0.2310472 Nov 11 11:56:57.456824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Attempting to bind port 503f62f7-f533-4766-8da8-7233a950f84a on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:56:57.456824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Attempting to bind port 503f62f7-f533-4766-8da8-7233a950f84a by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:56:57.456824 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Attempting to bind port 503f62f7-f533-4766-8da8-7233a950f84a on network 573e3e39-f87a-4728-9797-ba0f2cdaf07a {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:56:57.482390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Port 503f62f7-f533-4766-8da8-7233a950f84a on network 573e3e39-f87a-4728-9797-ba0f2cdaf07a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:56:57.482869 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Attempting to bind port 503f62f7-f533-4766-8da8-7233a950f84a on network 573e3e39-f87a-4728-9797-ba0f2cdaf07a {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:56:57.490738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.511578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 56, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:56:57.512068 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Checking segment: {'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:57.512591 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Bound using segment: {'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:56:57.513504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Bound port: 503f62f7-f533-4766-8da8-7233a950f84a, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:56:57.513504 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.543769 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1fc2a4d7-7021-4dd7-b628-4fa71b51c4c7 req-06b010a6-ed85-4074-b9e6-4dec187104b3 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821347 Nov 11 11:56:57.624643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.650771 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] For port 503f62f7-f533-4766-8da8-7233a950f84a, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:56:57.655959 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] For port 503f62f7-f533-4766-8da8-7233a950f84a, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=503f62f7-f533-4766-8da8-7233a950f84a,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:56:57.666945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.669891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-7cb69b53-8236-4cbb-a991-9955514824ac tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:57.701746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=119e6726-9091-4981-ac72-71c8503fa754,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:57.704891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:57.711540 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.718456 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-38aedcdf-b8cd-42f5-bedd-e6e1c815bfca tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:57.741251 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.746446 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-bedf3b24-ab0e-4fd5-b135-1742bc159d9f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.3537033 Nov 11 11:56:57.747053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42268) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:57.756920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'security_group_rule': {'security_group_id': '1e86761f-1782-4ce0-a464-16c1324e3cbe', 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:57.763579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:57.768866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:security_group_rule and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:57.772840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:57.779988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.781910 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] 10.222.0.60 "PUT /v2.0/ports/503f62f7-f533-4766-8da8-7233a950f84a HTTP/1.1" status: 200 len: 1093 time: 1.4615481 Nov 11 11:56:57.782549 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:57.785653 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f1519220-11ac-4f9a-a744-3f7016e03b44', 'tag': '503f62f7-f533-4766-8da8-7233a950f84a'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:56:57.828024 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Pushing event updated for resources: {'Port': ['ID=503f62f7-f533-4766-8da8-7233a950f84a,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:57.833466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:57.845233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.857699 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f1519220-11ac-4f9a-a744-3f7016e03b44', 'tag': '503f62f7-f533-4766-8da8-7233a950f84a', 'status': 'completed', 'code': 200} Nov 11 11:56:57.931650 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.964595 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2aa3f0c9-1fbb-4432-9b36-f18a6608086e req-7fa79712-b152-43f0-aefd-7070a703b790 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 1096 time: 0.0863771 Nov 11 11:56:57.970001 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:57.972868 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-069caabd-2ab7-48c3-bef2-525817496dc3 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:57.998215 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=81dd0063-5b6b-4542-9c2f-7dbdee244ae8,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:58.003201 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:58.049110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.051528 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-22f9f51f-9293-4422-bc52-53c499ddb14d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.3022895 Nov 11 11:56:58.055121 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42274) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:58.063494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'security_group_rule': {'security_group_id': '1e86761f-1782-4ce0-a464-16c1324e3cbe', 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:58.072108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:58.077891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:security_group_rule and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:58.082625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:58.091462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:58.141593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa3f0c9-1fbb-4432-9b36-f18a6608086e req-b30d5b34-17f7-4872-959b-570cd1c89587 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:58.143216 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2aa3f0c9-1fbb-4432-9b36-f18a6608086e req-b30d5b34-17f7-4872-959b-570cd1c89587 service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1710224 Nov 11 11:56:58.147907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.167477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '7593b896-fda8-486e-851e-df431a45d2fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 4, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port': {'id': '7593b896-fda8-486e-851e-df431a45d2fe', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a7:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:48Z', 'updated_at': '2021-11-11T11:56:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'cf8e2fcb-c078-437c-bd2e-84f333ba37fc', 'name': '', 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'mac_address': 'fa:16:3e:c2:63:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '50f53655-b92a-4474-aa2b-0dbd51fe9929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:52Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 2, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'subnets': [{'id': '50f53655-b92a-4474-aa2b-0dbd51fe9929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:58.176005 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Checking router: 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:56:58.177061 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Updating router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 port cf8e2fcb-c078-437c-bd2e-84f333ba37fc binding host dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:202}} Nov 11 11:56:58.263403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.293255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.312719 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa3f0c9-1fbb-4432-9b36-f18a6608086e req-a2743caf-ff8f-485f-8bd1-e0e6d0daeb54 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:58.314396 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2aa3f0c9-1fbb-4432-9b36-f18a6608086e req-a2743caf-ff8f-485f-8bd1-e0e6d0daeb54 service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1647551 Nov 11 11:56:58.324375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.329257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dbce87c6-d4dc-4f08-ab1d-e36e88e97239 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:58.370778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3528d4b3-2c7c-4685-8607-f369cdfbb69f,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:58.375430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:58.420067 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.426096 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-dbca7e5c-7aae-4998-abed-683fb5a9e8fd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.3649626 Nov 11 11:56:58.426600 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42278) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:58.437926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'security_group_rule': {'security_group_id': '1e86761f-1782-4ce0-a464-16c1324e3cbe', 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:58.449422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:58.455877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:security_group_rule and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:58.460596 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:58.470137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:58.505552 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-709dfa2e-91ee-4520-b8d3-6592c3599507 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 1096 time: 0.1443677 Nov 11 11:56:58.513018 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.securitygroups_db [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Project 5d0ef0fa307d43119524263d91d2b2e4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 11:56:58.540501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.625662 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-a93c8dcd-3ae1-4a42-aa57-1291ba139436 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=503f62f7-f533-4766-8da8-7233a950f84a HTTP/1.1" status: 200 len: 217 time: 0.1123352 Nov 11 11:56:58.665706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.700893 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.710160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:58.737023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=31a15ec3-985f-4c67-b106-226e83ce8549,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:58.739895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:58.768980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Notify callbacks [] for port, precommit_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.783903 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Transition to ACTIVE for port object cf8e2fcb-c078-437c-bd2e-84f333ba37fc will not be triggered until provisioned by entity L2. {{(pid=88331) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:56:58.792709 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.797360 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-63ec605c-bea2-4a32-8ee2-14e79c061608 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.3660131 Nov 11 11:56:58.798921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 42284) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:56:58.803073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-ed487b59-0ad9-4ba1-ba8d-f4cc4d80ae92 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:58.804696 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-ed487b59-0ad9-4ba1-ba8d-f4cc4d80ae92 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=cc8dffe4-8474-48ed-be47-5f9462fe407d HTTP/1.1" status: 200 len: 854 time: 0.1736357 Nov 11 11:56:58.806499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'security_group_rule': {'security_group_id': '1e86761f-1782-4ce0-a464-16c1324e3cbe', 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88328) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:56:58.813723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:56:58.818329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:security_group_rule and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:56:58.821125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.822064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88328) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:56:58.828814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b8867650-5499-4eb8-b706-093a08d36839 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:58.829505 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88328) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:56:58.863599 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-f139326f-ffc9-441f-8b25-9e91e12914fd service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=573e3e39-f87a-4728-9797-ba0f2cdaf07a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0503268 Nov 11 11:56:58.873668 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.securitygroups_db [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Project 5d0ef0fa307d43119524263d91d2b2e4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 11:56:58.890886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:58.985929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ce9ca6-c4ac-4f79-8f1f-bbfaeb1390be None None] Pushing event updated for resources: {'Port': ['ID=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,revision_number=3']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:58.993857 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f8ce9ca6-c4ac-4f79-8f1f-bbfaeb1390be None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:59.049401 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:59.054108 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70f7fd-5ca6-4604-bf9a-3a3f20ee513c req-a400c150-8fc3-4918-9f76-cb70d5b89698 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:56:59.056362 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd70f7fd-5ca6-4604-bf9a-3a3f20ee513c req-a400c150-8fc3-4918-9f76-cb70d5b89698 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 943 time: 0.3083317 Nov 11 11:56:59.095681 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741249'] for security_group_rule, after_create {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:59.114902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Attempting to bind port cf8e2fcb-c078-437c-bd2e-84f333ba37fc on host dv-cinder-817417-1-iscsi for vnic_type normal with profile {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:56:59.115993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Attempting to bind port cf8e2fcb-c078-437c-bd2e-84f333ba37fc by drivers openvswitch,hyperv on host dv-cinder-817417-1-iscsi at level 0 using segments [{'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:56:59.115993 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Attempting to bind port cf8e2fcb-c078-437c-bd2e-84f333ba37fc on network 53517e7f-50da-4273-ad84-f2e9aaa53e29 {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:56:59.123872 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Checking agent: {'id': '68d62f32-d5c8-4805-afdd-441aa65ffdd4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-817417-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 31, 41), 'started_at': datetime.datetime(2021, 11, 11, 11, 32, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 56, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-817417-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:56:59.124335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Checking segment: {'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88331) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:56:59.124545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:59.124886 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:59.125484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Bound using segment: {'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'} {{(pid=88331) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:56:59.126309 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Bound port: cf8e2fcb-c078-437c-bd2e-84f333ba37fc, host: dv-cinder-817417-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a1d0522-cde2-430d-be8b-2969439679f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1007, 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29'}}] {{(pid=88331) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:56:59.126982 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:59.146127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=47abe070-2f2c-46c1-ab51-5e82644e3300,revision_number=0']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:59.150509 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:59.155804 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:59.165446 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c4f420c6-2002-490b-9fac-2f428a6ed498 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.3648548 Nov 11 11:56:59.193907 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-24e94efd-0552-4a2a-baf8-eb3fa43d1bd6 service neutron] 10.222.0.60 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3226173 Nov 11 11:56:59.201242 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd70f7fd-5ca6-4604-bf9a-3a3f20ee513c req-669de147-fa57-4e79-8eec-a8634b437327 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1338227 Nov 11 11:56:59.299421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] For port cf8e2fcb-c078-437c-bd2e-84f333ba37fc, host dv-cinder-817417-1-iscsi, cleared binding levels {{(pid=88331) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:56:59.305944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] For port cf8e2fcb-c078-437c-bd2e-84f333ba37fc, host dv-cinder-817417-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,segment=NetworkSegment(9a1d0522-cde2-430d-be8b-2969439679f0),segment_id=9a1d0522-cde2-430d-be8b-2969439679f0)] {{(pid=88331) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:56:59.341486 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88331) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:56:59.346599 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:56:59.405080 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-396f968a-eab1-4cc3-8d6c-6dc93d35beeb req-629c643e-0844-4e43-b5e7-f4a628227a80 service neutron] 10.222.0.60 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2021592 Nov 11 11:56:59.435438 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ce9ca6-c4ac-4f79-8f1f-bbfaeb1390be None None] Pushing event updated for resources: {'Port': ['ID=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,revision_number=4']} {{(pid=88331) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:56:59.441216 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f8ce9ca6-c4ac-4f79-8f1f-bbfaeb1390be None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=88331) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:56:59.445832 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Routers {'9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:56:59.446931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:56:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:56:59.693896 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] Set router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:57:00.152434 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '7593b896-fda8-486e-851e-df431a45d2fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 4, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port': {'id': '7593b896-fda8-486e-851e-df431a45d2fe', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a7:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:48Z', 'updated_at': '2021-11-11T11:56:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'cf8e2fcb-c078-437c-bd2e-84f333ba37fc', 'name': '', 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'mac_address': 'fa:16:3e:c2:63:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '50f53655-b92a-4474-aa2b-0dbd51fe9929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:52Z', 'updated_at': '2021-11-11T11:56:59Z', 'revision_number': 4, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'subnets': [{'id': '50f53655-b92a-4474-aa2b-0dbd51fe9929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:57:00.160661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ee8bba0-1f5c-4a1b-866e-a5ed53828af6 None None] The sync data for ids ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'] in dv-cinder-817417-1-iscsi is: [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '7593b896-fda8-486e-851e-df431a45d2fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 4, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port': {'id': '7593b896-fda8-486e-851e-df431a45d2fe', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a7:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:48Z', 'updated_at': '2021-11-11T11:56:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'cf8e2fcb-c078-437c-bd2e-84f333ba37fc', 'name': '', 'network_id': '53517e7f-50da-4273-ad84-f2e9aaa53e29', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'mac_address': 'fa:16:3e:c2:63:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '50f53655-b92a-4474-aa2b-0dbd51fe9929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:52Z', 'updated_at': '2021-11-11T11:56:59Z', 'revision_number': 4, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'subnets': [{'id': '50f53655-b92a-4474-aa2b-0dbd51fe9929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:57:00.525385 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54fc1dd-1328-43f8-837d-1ecfdb30a979 req-24a17c71-c431-4c3d-bdeb-27dbf182827f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:00.527557 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f54fc1dd-1328-43f8-837d-1ecfdb30a979 req-24a17c71-c431-4c3d-bdeb-27dbf182827f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 943 time: 0.1551242 Nov 11 11:57:00.593137 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f54fc1dd-1328-43f8-837d-1ecfdb30a979 req-ac6ca73d-11d6-4339-86c2-abbbb9edd37a tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571613 Nov 11 11:57:00.970345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device cf8e2fcb-c078-437c-bd2e-84f333ba37fc up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:57:01.095592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning for port cf8e2fcb-c078-437c-bd2e-84f333ba37fc completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:57:01.101288 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port cf8e2fcb-c078-437c-bd2e-84f333ba37fc triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:57:01.101720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:01.239112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:01.275247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] For port cf8e2fcb-c078-437c-bd2e-84f333ba37fc, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,segment=NetworkSegment(9a1d0522-cde2-430d-be8b-2969439679f0),segment_id=9a1d0522-cde2-430d-be8b-2969439679f0)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:57:01.306974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:01.309583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:01.406593 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Pushing event updated for resources: {'Port': ['ID=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:01.410134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:01.807363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 503f62f7-f533-4766-8da8-7233a950f84a details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:57:01.826248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9d0483a-f7a9-4413-89e6-7f77c5efe626 req-3077d0b4-655f-4bf6-8074-d8120cfd9c25 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:01.829121 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9d0483a-f7a9-4413-89e6-7f77c5efe626 req-3077d0b4-655f-4bf6-8074-d8120cfd9c25 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 943 time: 0.0920734 Nov 11 11:57:01.889048 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a9d0483a-f7a9-4413-89e6-7f77c5efe626 req-c872ea45-3ce6-4efb-917c-aacdf0be681a tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534437 Nov 11 11:57:01.964344 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 503f62f7-f533-4766-8da8-7233a950f84a, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=503f62f7-f533-4766-8da8-7233a950f84a,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:57:01.983268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '503f62f7-f533-4766-8da8-7233a950f84a', 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a', 'port_id': '503f62f7-f533-4766-8da8-7233a950f84a', 'mac_address': 'fa:16:3e:75:a9:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1009, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc8dffe4-8474-48ed-be47-5f9462fe407d', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:57:02.059639 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:02.082972 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 503f62f7-f533-4766-8da8-7233a950f84a {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:57:02.100199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 503f62f7-f533-4766-8da8-7233a950f84a, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=503f62f7-f533-4766-8da8-7233a950f84a,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:57:02.135470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:02.137908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:02.232734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=503f62f7-f533-4766-8da8-7233a950f84a,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:02.237876 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:02.502920 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['503f62f7-f533-4766-8da8-7233a950f84a'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:57:02.942021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device cf8e2fcb-c078-437c-bd2e-84f333ba37fc up at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:57:03.022038 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Provisioning complete for port cf8e2fcb-c078-437c-bd2e-84f333ba37fc triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:57:03.022463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:03.151996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49250c0c-afe6-47cf-b4a0-cb50bc5bfda2 req-cf902666-d2bf-40bf-85f9-07b42fc688ee tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:03.155081 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49250c0c-afe6-47cf-b4a0-cb50bc5bfda2 req-cf902666-d2bf-40bf-85f9-07b42fc688ee tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 944 time: 0.1047215 Nov 11 11:57:03.210534 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-49250c0c-afe6-47cf-b4a0-cb50bc5bfda2 req-54e72770-14ec-42e1-84b3-083800be6d32 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471284 Nov 11 11:57:03.805922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 503f62f7-f533-4766-8da8-7233a950f84a up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:57:03.935392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 503f62f7-f533-4766-8da8-7233a950f84a completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:57:03.942157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 503f62f7-f533-4766-8da8-7233a950f84a triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:57:03.942661 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:04.072463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:04.102136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1519220-11ac-4f9a-a744-3f7016e03b44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '503f62f7-f533-4766-8da8-7233a950f84a'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:57:04.114244 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 503f62f7-f533-4766-8da8-7233a950f84a, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=503f62f7-f533-4766-8da8-7233a950f84a,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:57:04.158285 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:04.161492 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1519220-11ac-4f9a-a744-3f7016e03b44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '503f62f7-f533-4766-8da8-7233a950f84a', 'code': 200} Nov 11 11:57:04.162049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:04.231021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=503f62f7-f533-4766-8da8-7233a950f84a,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:04.235044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:04.510416 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781c1ddc-bf26-4b96-91c1-dc26c32f15ad req-786e4f77-cec7-443b-9149-84e4881e4696 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:04.512053 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-781c1ddc-bf26-4b96-91c1-dc26c32f15ad req-786e4f77-cec7-443b-9149-84e4881e4696 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 945 time: 0.1507258 Nov 11 11:57:04.516781 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fa144ed9-0431-4c70-b556-5e83f547f110 req-0baa5907-9138-4565-a43d-4d71a31b6eda service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 1098 time: 0.1200278 Nov 11 11:57:04.595106 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-781c1ddc-bf26-4b96-91c1-dc26c32f15ad req-1f21a7e9-4f13-4b9e-a3ef-9c579fc68138 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0757928 Nov 11 11:57:04.599473 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fa144ed9-0431-4c70-b556-5e83f547f110 req-d1029ad3-f2be-4856-af1a-542238bb2087 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625007 Nov 11 11:57:04.815050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:05.818246 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2238fb5d-2464-4ff6-b301-2a11f637015b req-c9260351-9a04-4955-a2b2-394cae4def7b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:05.819939 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2238fb5d-2464-4ff6-b301-2a11f637015b req-c9260351-9a04-4955-a2b2-394cae4def7b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 945 time: 0.0956056 Nov 11 11:57:05.878925 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2238fb5d-2464-4ff6-b301-2a11f637015b req-ee1b6832-60f3-4b7f-a3d4-cbabbfe46fcf tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450032 Nov 11 11:57:07.091919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea1468fc-ced7-4500-804b-1c96fb60cd3f req-acb073b3-4037-40f5-9b75-712a3849efb5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:07.093510 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ea1468fc-ced7-4500-804b-1c96fb60cd3f req-acb073b3-4037-40f5-9b75-712a3849efb5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 945 time: 0.0864944 Nov 11 11:57:07.149050 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ea1468fc-ced7-4500-804b-1c96fb60cd3f req-2f5b42ae-1880-4236-bf2f-22448ce95698 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491426 Nov 11 11:57:10.033812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8dd690b8-3e2e-46d9-b162-e1517729b470 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:11.271895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:13.496404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-b663d986-4682-4bc0-9eba-c31d180c0d37 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:13.546137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:14.725295 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:19.625908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:57:25.142132 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-c579c32b-1ad1-491b-8e2b-0ac46d2cd79c service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2876313 Nov 11 11:57:25.289380 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-cb88e613-60b0-4e3c-bf6c-45d802a24f7d service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 1098 time: 0.0725870 Nov 11 11:57:25.441579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-d4dcd465-de96-479a-be07-917044cc714a service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:25.443266 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-d4dcd465-de96-479a-be07-917044cc714a service neutron] 10.222.0.60 "GET /v2.0/networks?id=573e3e39-f87a-4728-9797-ba0f2cdaf07a HTTP/1.1" status: 200 len: 916 time: 0.1343894 Nov 11 11:57:25.521214 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-37bf08e5-f4ed-4356-94fa-d9e1038734e8 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=503f62f7-f533-4766-8da8-7233a950f84a HTTP/1.1" status: 200 len: 217 time: 0.0711665 Nov 11 11:57:25.594363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-935de017-793a-4482-b859-25d634080c1b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:25.596535 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-935de017-793a-4482-b859-25d634080c1b service neutron] 10.222.0.60 "GET /v2.0/subnets?id=cc8dffe4-8474-48ed-be47-5f9462fe407d HTTP/1.1" status: 200 len: 854 time: 0.0684345 Nov 11 11:57:25.647862 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-76918d06-dd17-44f5-a13a-bc9852feccab service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=573e3e39-f87a-4728-9797-ba0f2cdaf07a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0434127 Nov 11 11:57:25.797586 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-ef3ced38-d428-493e-aa6d-d1a7938fdf2d service neutron] 10.222.0.60 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1417089 Nov 11 11:57:25.938724 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fc553abe-d008-4ecd-8cca-d3e78f74a799 req-83fee0f4-3878-4dea-bc18-ebc0d1a59bd2 service neutron] 10.222.0.60 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1330733 Nov 11 11:57:29.148420 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-b82dcc82-c215-47d2-b804-1b1ff4c29e1a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-82402078&fields=id&tenant_id=5d0ef0fa307d43119524263d91d2b2e4 HTTP/1.1" status: 200 len: 267 time: 0.0464082 Nov 11 11:57:29.310156 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-ecece714-62d5-4fd9-a22d-a3c292710dd2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:29.311801 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-ecece714-62d5-4fd9-a22d-a3c292710dd2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 808 time: 0.1561782 Nov 11 11:57:29.330660 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-601ca20b-6b59-460b-b6c2-77f861bd5b9c tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/quotas/5d0ef0fa307d43119524263d91d2b2e4 HTTP/1.1" status: 200 len: 375 time: 0.0118878 Nov 11 11:57:29.421372 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-6155313d-29ec-4251-9079-dd962efb6248 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0848584 Nov 11 11:57:29.575487 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-7fe6998e-d416-4a7a-a21d-610f47273f26 service neutron] 10.222.0.11 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1407237 Nov 11 11:57:29.719157 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-661d60a4-07bd-4771-a288-9d49570b92be service neutron] 10.222.0.11 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371496 Nov 11 11:57:30.321625 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4778a032-b149-4a67-8e9a-4cda13e10afe req-aa70f391-e45a-4701-a3bf-09683898f2b3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 210 time: 0.0454216 Nov 11 11:57:31.497841 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8e731264-2dc4-4793-8608-c6c0d00a37cf req-8d7e70d1-599b-41ab-868e-b029b137142d tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 210 time: 0.0463011 Nov 11 11:57:32.374613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-187c890f-e993-49f2-a5bf-4b8a31a5ebb7 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:32.376113 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-187c890f-e993-49f2-a5bf-4b8a31a5ebb7 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 808 time: 0.1595094 Nov 11 11:57:32.433282 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-6465917f-e1c2-45a8-9343-5758e466ff5e tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.60 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5d0ef0fa307d43119524263d91d2b2e4 HTTP/1.1" status: 200 len: 378 time: 0.0451770 Nov 11 11:57:32.442346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'port': {'device_id': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'admin_state_up': True, 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'security_groups': ['1e86761f-1782-4ce0-a464-16c1324e3cbe']}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:57:32.621510 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:57:32.627235 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:port and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:57:32.630611 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:57:32.637823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:57:32.707630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Made reservation on behalf of 5d0ef0fa307d43119524263d91d2b2e4 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:57:32.713142 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:32.731041 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-053b58aa-7ff7-418c-bda7-e689a717058f req-78f00941-6149-46f5-89de-80b72464eb95 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 210 time: 0.0665009 Nov 11 11:57:32.897696 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Allocated IP 172.20.0.5 (5d525e47-392a-4037-a12e-ef51f3af2313/b56fb566-0eb1-4687-8b21-11f7dabfd9bd/16de7b1f-2577-472b-b6f9-54cb9aca54c2) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:57:33.101320 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:33.119855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Transition to ACTIVE for port object 16de7b1f-2577-472b-b6f9-54cb9aca54c2 will not be triggered until provisioned by entity DHCP. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:57:33.165218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:33.171808 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2cbd352c-2796-4588-a2df-01ea18ca3087 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:33.244795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Network 5d525e47-392a-4037-a12e-ef51f3af2313 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:57:33.249026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:57:33.254105 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:57:33.301575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:33.321275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.321694 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.322104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.322503 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.322899 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.323339 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.323734 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.324122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.324513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.324900 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.325287 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:57:33.331256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:33.340921 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:33.341621 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:33.511485 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-931647fd-f14a-4867-8f13-c0b47e686f2a tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0730939 Nov 11 11:57:33.524131 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Request body: {'port': {'device_id': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:57:33.606668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-628a8ebe-e8bb-44bf-a982-8b39c5f5cb39 None None] Provisioning for port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 completed by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:57:33.612390 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-628a8ebe-e8bb-44bf-a982-8b39c5f5cb39 None None] Provisioning complete for port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 triggered by entity DHCP. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:57:33.620588 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-628a8ebe-e8bb-44bf-a982-8b39c5f5cb39 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:33.645255 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:33.668887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-628a8ebe-e8bb-44bf-a982-8b39c5f5cb39 None None] Port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 cannot update to ACTIVE because it is not bound. {{(pid=88330) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:307}} Nov 11 11:57:34.020055 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e326cb0-42da-444d-a716-bba39c069d3f req-7742caa2-7790-4ddc-97f2-7e0b7f173ffe tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:34.020849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-1e326cb0-42da-444d-a716-bba39c069d3f req-7742caa2-7790-4ddc-97f2-7e0b7f173ffe tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Synchronizing usage tracker for tenant:5d0ef0fa307d43119524263d91d2b2e4 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:57:34.101434 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 16de7b1f-2577-472b-b6f9-54cb9aca54c2 {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:57:34.108968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:34.125475 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-1e326cb0-42da-444d-a716-bba39c069d3f req-7742caa2-7790-4ddc-97f2-7e0b7f173ffe tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Unset dirty status for tenant:5d0ef0fa307d43119524263d91d2b2e4 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:57:34.126749 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e326cb0-42da-444d-a716-bba39c069d3f req-7742caa2-7790-4ddc-97f2-7e0b7f173ffe tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 931 time: 0.2373009 Nov 11 11:57:34.130460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Transition to ACTIVE for port object 16de7b1f-2577-472b-b6f9-54cb9aca54c2 will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:57:34.180199 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1e326cb0-42da-444d-a716-bba39c069d3f req-b21f3be9-b0af-4f76-9f5b-61ec80ac6271 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0468869 Nov 11 11:57:34.200793 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:34.205220 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-23ffb46c-f6dd-49ef-8532-05976bbbc176 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:34.338721 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Pushing event updated for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:34.342034 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:34.466256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Attempting to bind port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:57:34.466884 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Attempting to bind port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:57:34.467473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Attempting to bind port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 on network 5d525e47-392a-4037-a12e-ef51f3af2313 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:57:34.476710 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 on network 5d525e47-392a-4037-a12e-ef51f3af2313 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:57:34.477198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Attempting to bind port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 on network 5d525e47-392a-4037-a12e-ef51f3af2313 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:57:34.485809 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 57, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:57:34.486225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Checking segment: {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:57:34.486680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Bound using segment: {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:57:34.487207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Bound port: 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f9defc44-85fd-41dc-bbc4-4667ef350570', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1031, 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:57:34.487604 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:34.602241 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:57:34.605668 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:57:34.647838 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:34.652050 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ba1a6bf9-7373-499a-b4cd-22470a2f5992 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:34.705141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:34.706825 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] 10.222.0.60 "PUT /v2.0/ports/16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 1093 time: 1.1879327 Nov 11 11:57:34.710247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:57:34.741280 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Pushing event updated for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:34.750226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-fbd3911d-b7d9-4e6f-8b19-fb8b6baae33d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:34.816042 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:34.862490 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'status': 'completed', 'code': 200} Nov 11 11:57:34.871733 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-91b3f6cd-7b93-4698-a0ae-58f66ab7e896 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1096 time: 0.0894578 Nov 11 11:57:34.946217 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-0c420d4e-df1c-46e4-ad7e-929b8c94a558 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 217 time: 0.0668654 Nov 11 11:57:35.020473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-5b1844eb-ea4b-4001-ab43-baa6d7cade31 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:35.022010 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-5b1844eb-ea4b-4001-ab43-baa6d7cade31 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0690284 Nov 11 11:57:35.104877 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-b3b84a6f-2a97-4952-ab5b-54b18dd29306 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0755575 Nov 11 11:57:35.525124 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-3cb938b8-e64a-4922-b804-c35587312da0 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4137909 Nov 11 11:57:35.584864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5b28e5-1b3e-408b-99ba-9a7106c60fd0 req-53f6c142-eb05-44cf-857c-2a22f80f2a65 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:35.586477 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5b28e5-1b3e-408b-99ba-9a7106c60fd0 req-53f6c142-eb05-44cf-857c-2a22f80f2a65 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.1651089 Nov 11 11:57:35.718920 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0a5b28e5-1b3e-408b-99ba-9a7106c60fd0 req-19ce4882-5588-4d7d-8c63-d9a8ad2896f9 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0842433 Nov 11 11:57:35.722363 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bf41400d-05ce-4d1a-bc01-dfb731b2440a req-644549f2-adf3-4baa-81c5-bf29dac9a33e service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1882422 Nov 11 11:57:35.884080 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-02a16398-cfce-4b10-9c61-810f0010592e service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1096 time: 0.0779409 Nov 11 11:57:36.030008 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-436f92b9-9581-4493-a1b5-f85f9d10546d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:36.031543 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-436f92b9-9581-4493-a1b5-f85f9d10546d service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.1402190 Nov 11 11:57:36.108852 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-534afbed-d0ec-439e-bf4f-b8be5454cf31 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 217 time: 0.0706589 Nov 11 11:57:36.179582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-99ced342-033f-47cf-a74e-bd9b294537c4 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:36.181156 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-99ced342-033f-47cf-a74e-bd9b294537c4 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0664001 Nov 11 11:57:36.268192 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-da8aa288-7c25-4bce-adac-41da4c8cd118 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0795565 Nov 11 11:57:36.416103 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-df0fb9a9-2fae-4007-bb99-c844b6034e65 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1412868 Nov 11 11:57:36.573832 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-aa193ef4-15a4-4dd7-b8b0-b5e0ef58de47 req-7ebfb4bc-0e0b-4c65-b56b-3df3f3835211 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1499002 Nov 11 11:57:36.928415 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771f2756-651f-4991-a90e-c0efeff599c5 req-48d4697f-4230-40db-bd0b-9fdd12c08988 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:36.930035 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-771f2756-651f-4991-a90e-c0efeff599c5 req-48d4697f-4230-40db-bd0b-9fdd12c08988 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0851772 Nov 11 11:57:36.980413 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-771f2756-651f-4991-a90e-c0efeff599c5 req-aaf83d5e-7be1-4863-9a44-57a9674367d3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0438027 Nov 11 11:57:38.345794 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d822c64d-45b8-4c9f-a72b-bdcd71026514 req-573795bd-51bd-4cb7-b611-9b1e71b6dcda tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:38.347375 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d822c64d-45b8-4c9f-a72b-bdcd71026514 req-573795bd-51bd-4cb7-b611-9b1e71b6dcda tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0891223 Nov 11 11:57:38.397602 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d822c64d-45b8-4c9f-a72b-bdcd71026514 req-2ebe4f22-70ff-4584-b8c2-ac35494da8dd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0434425 Nov 11 11:57:39.606261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ca5429-2c31-4f68-a026-b5ebaea642e0 req-b3b7e425-23f1-44f7-b394-4bed9cf6b292 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:39.607904 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-65ca5429-2c31-4f68-a026-b5ebaea642e0 req-b3b7e425-23f1-44f7-b394-4bed9cf6b292 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0847421 Nov 11 11:57:39.657553 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-65ca5429-2c31-4f68-a026-b5ebaea642e0 req-180aab67-39fc-417d-b0fc-d4416fdc1cd2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431483 Nov 11 11:57:40.041062 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8b13d7e4-c53d-499b-84c4-60e623efb5eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:40.873140 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be0c7ed-2bce-4555-b242-bd0d68242a3f req-dea02180-c701-4ee3-95c4-5bcd3e6fd5bd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:40.874731 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1be0c7ed-2bce-4555-b242-bd0d68242a3f req-dea02180-c701-4ee3-95c4-5bcd3e6fd5bd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0884962 Nov 11 11:57:40.938782 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-1be0c7ed-2bce-4555-b242-bd0d68242a3f req-b82dfb5e-eca2-40ac-8ab9-818e1fb8df54 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0566280 Nov 11 11:57:41.281359 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:42.175816 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f9cb3e-d795-495b-948d-77bfc4f3e4b4 req-1a8f6920-e43d-45d8-b502-87dd949a3462 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:42.177442 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a6f9cb3e-d795-495b-948d-77bfc4f3e4b4 req-1a8f6920-e43d-45d8-b502-87dd949a3462 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0855596 Nov 11 11:57:42.227020 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a6f9cb3e-d795-495b-948d-77bfc4f3e4b4 req-62793424-bd10-4d30-b077-8b619fb16ea6 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428402 Nov 11 11:57:43.438736 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b00cfb4-2120-4d6b-af57-cfaf2b43eac4 req-e9dc6389-4bbb-40ef-90f4-8e4928bdaa03 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:43.440288 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b00cfb4-2120-4d6b-af57-cfaf2b43eac4 req-e9dc6389-4bbb-40ef-90f4-8e4928bdaa03 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0868382 Nov 11 11:57:43.489603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b00cfb4-2120-4d6b-af57-cfaf2b43eac4 req-b8734a79-d2b0-45ae-aca9-8f44e6a27c46 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0423670 Nov 11 11:57:43.491747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-646b78d8-085f-4fb4-ad2b-602fedb22992 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:43.544184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:43.957172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 16de7b1f-2577-472b-b6f9-54cb9aca54c2 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:57:44.108720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:57:44.123891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'port_id': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'mac_address': 'fa:16:3e:01:5a:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1031, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:57:44.187250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:44.206136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 16de7b1f-2577-472b-b6f9-54cb9aca54c2 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:57:44.222413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:57:44.258574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:44.261391 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-27e70f1b-0419-48ea-a8b3-c50abc3ea430 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:44.334576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:44.338836 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:44.602524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['16de7b1f-2577-472b-b6f9-54cb9aca54c2'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:57:44.702335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87fd826-42b2-4adb-a0f8-55e4a30d57af req-d3b6dc67-ddd1-40e9-830d-a24182522531 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:44.703982 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e87fd826-42b2-4adb-a0f8-55e4a30d57af req-d3b6dc67-ddd1-40e9-830d-a24182522531 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 944 time: 0.0854301 Nov 11 11:57:44.736691 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:44.760919 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e87fd826-42b2-4adb-a0f8-55e4a30d57af req-1b981d14-b19d-4d63-b129-e1de2d030d73 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0496385 Nov 11 11:57:45.981184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e77d994d-c1ef-48b6-8bf5-d5f64c1c6dcc req-ed827127-4840-4862-bc17-74e469d5c2cd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:45.982853 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e77d994d-c1ef-48b6-8bf5-d5f64c1c6dcc req-ed827127-4840-4862-bc17-74e469d5c2cd tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 944 time: 0.0868433 Nov 11 11:57:45.987701 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 16de7b1f-2577-472b-b6f9-54cb9aca54c2 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:57:46.037692 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e77d994d-c1ef-48b6-8bf5-d5f64c1c6dcc req-5c8b7a9d-ca5d-4076-9e2b-73fd058b6f0b tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0473917 Nov 11 11:57:46.102494 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:57:46.107944 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:57:46.108372 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:46.241304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:46.266004 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:57:46.277345 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:57:46.311128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:46.313304 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:46.351827 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'code': 200} Nov 11 11:57:46.394491 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:46.398183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:46.750257 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7bebf64c-1ae6-47d1-a47b-58d131f0835a req-8b187ee7-81b2-4da8-9539-d1e59b465314 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.0796208 Nov 11 11:57:46.798660 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7bebf64c-1ae6-47d1-a47b-58d131f0835a req-6dff7f90-05a8-46a3-a077-b38666886087 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0411496 Nov 11 11:57:47.294814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edda51be-0244-4eff-b314-3737e755b312 req-89703251-988c-46c1-bb51-d65d1b70b6db tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:47.296936 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-edda51be-0244-4eff-b314-3737e755b312 req-89703251-988c-46c1-bb51-d65d1b70b6db tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0962343 Nov 11 11:57:47.361213 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-edda51be-0244-4eff-b314-3737e755b312 req-f2067783-d809-469e-84a2-421b948d3fbc tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0568237 Nov 11 11:57:48.572473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a659430-23c1-4185-b3d7-6dd0245b89bc req-b418facc-51ae-40d0-8ffb-2adc42de5e60 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:48.574074 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6a659430-23c1-4185-b3d7-6dd0245b89bc req-b418facc-51ae-40d0-8ffb-2adc42de5e60 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0880015 Nov 11 11:57:48.627745 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6a659430-23c1-4185-b3d7-6dd0245b89bc req-a0b7668b-6895-4c92-9e24-6f43ffea6c84 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428224 Nov 11 11:57:48.842306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6ddbb2b-0a8a-44f1-88a4-5567a907f543 req-e7967e39-7cd5-4ae7-b1d3-95e27f380a55 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:48.844493 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e6ddbb2b-0a8a-44f1-88a4-5567a907f543 req-e7967e39-7cd5-4ae7-b1d3-95e27f380a55 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0931711 Nov 11 11:57:48.898216 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e6ddbb2b-0a8a-44f1-88a4-5567a907f543 req-97b27484-0d5e-4f97-943a-b99088449da6 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0474670 Nov 11 11:57:48.925542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42638) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:57:49.072895 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0ae120ea-d76f-454a-9a44-66477c7340aa tempest-TestShelveInstance-857670008 tempest-TestShelveInstance-857670008-project-admin] Synchronizing usage tracker for tenant:c129fc4304924d1cbaff9412e4c54ebe on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:57:49.150649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-0ae120ea-d76f-454a-9a44-66477c7340aa tempest-TestShelveInstance-857670008 tempest-TestShelveInstance-857670008-project-admin] Unset dirty status for tenant:c129fc4304924d1cbaff9412e4c54ebe on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:57:49.152269 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-0ae120ea-d76f-454a-9a44-66477c7340aa tempest-TestShelveInstance-857670008 tempest-TestShelveInstance-857670008-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1093 time: 0.2255766 Nov 11 11:57:49.155445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 42644) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:57:49.161660 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Request body: {'floatingip': {'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'port_id': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'fixed_ip_address': '172.20.0.5'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:57:49.169583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:57:49.173844 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Usage tracker for resource:floatingip and tenant:5d0ef0fa307d43119524263d91d2b2e4 is out of sync, need to count used quota {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Nov 11 11:57:49.176980 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88329) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Nov 11 11:57:49.184124 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:57:49.219595 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for floatingip, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:49.373464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:49.516195 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Allocated IP 172.27.3.179 (f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5/168d25bd-1d7e-499b-bc86-5ae1423a4145/b294a159-86e1-49f7-ba57-f8f76e3dad73) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:57:49.670919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:49.716298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:49.720923 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-602a6820-1aae-4d03-931e-8364e7e726bd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:49.779855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Network f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5 is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:57:49.786955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:57:49.792045 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:57:49.830126 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'Port': ['ID=b294a159-86e1-49f7-ba57-f8f76e3dad73,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:49.839292 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:50.332782 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:50.408928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:50.834818 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:50.868499 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:50.873136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2520d2f2-ef21-49dc-8091-78addd240898 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:57:50.983717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event updated for resources: {'Port': ['ID=b294a159-86e1-49f7-ba57-f8f76e3dad73,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:57:50.988196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:57:50.997460 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036850736397'] for floatingip, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:51.202088 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.db.l3_db [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Floating IP 54a1bfa5-29dd-49d1-99fa-12cfa134bb1b associated. External IP: 172.27.3.179, port: 16de7b1f-2577-472b-b6f9-54cb9aca54c2. Nov 11 11:57:51.609378 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88329) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 11:57:51.813097 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88329) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 11:57:51.824546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] Sync routers for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 11:57:51.838687 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:57:51.839393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:57:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:57:51.876365 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:57:51.932969 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-9cc94965-582f-4029-9f50-05e28bec9668 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.7762389 Nov 11 11:57:51.933652 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:57:51.991111 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'status': 'completed', 'code': 200} Nov 11 11:57:52.030484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:57:52.250099 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d253732f-641a-4980-9875-62ad1b83c7ad req-9c1696e5-cbd0-4e2f-9e79-5fdfc3c419a9 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.0818250 Nov 11 11:57:52.404208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253732f-641a-4980-9875-62ad1b83c7ad req-78e4bb76-584e-413b-8514-fa8661c1e554 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:52.405871 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d253732f-641a-4980-9875-62ad1b83c7ad req-78e4bb76-584e-413b-8514-fa8661c1e554 service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.1485085 Nov 11 11:57:52.415925 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '54a1bfa5-29dd-49d1-99fa-12cfa134bb1b', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'floating_ip_address': '172.27.3.179', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'port_id': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'mac_address': 'fa:16:3e:01:5a:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:57:50Z', 'updated_at': '2021-11-11T11:57:50Z', 'revision_number': 0, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 5, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:57:52.420800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] Checking router: 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 11:57:52.433791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 11:57:52.434488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T11:57:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:57:52.522032 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d253732f-641a-4980-9875-62ad1b83c7ad req-bb17273f-1da8-4d1e-aceb-51360dc7bcc4 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 999 time: 0.1088457 Nov 11 11:57:52.599055 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253732f-641a-4980-9875-62ad1b83c7ad req-1295a07a-e59f-48a2-8498-a77b60bea225 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:57:52.600991 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d253732f-641a-4980-9875-62ad1b83c7ad req-1295a07a-e59f-48a2-8498-a77b60bea225 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0729210 Nov 11 11:57:52.630323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 11:57:52.693118 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d253732f-641a-4980-9875-62ad1b83c7ad req-a87e274c-67b7-4083-a338-cd21d4ba20cf service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0855041 Nov 11 11:57:52.838028 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d253732f-641a-4980-9875-62ad1b83c7ad req-ea64ef35-5f05-4120-be4e-55d40ae3beb9 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1379862 Nov 11 11:57:52.988376 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d253732f-641a-4980-9875-62ad1b83c7ad req-ff570fa7-46ce-4a9c-895a-6455b4d9234e service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1432078 Nov 11 11:57:53.006785 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '54a1bfa5-29dd-49d1-99fa-12cfa134bb1b', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'floating_ip_address': '172.27.3.179', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'port_id': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'mac_address': 'fa:16:3e:01:5a:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:57:50Z', 'updated_at': '2021-11-11T11:57:50Z', 'revision_number': 0, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 5, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:57:53.011072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beb0d1c9-8214-45f4-8534-5e80f0d161e5 None None] The sync data for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi is: [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_floatingips': [{'id': '54a1bfa5-29dd-49d1-99fa-12cfa134bb1b', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'floating_ip_address': '172.27.3.179', 'floating_network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'router_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'port_id': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'mac_address': 'fa:16:3e:01:5a:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T11:57:50Z', 'updated_at': '2021-11-11T11:57:50Z', 'revision_number': 0, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 5, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 11:57:53.386027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaff5d7d-f8ec-4064-b24e-f4f8e99693db None None] New status for floating IP 54a1bfa5-29dd-49d1-99fa-12cfa134bb1b: ACTIVE {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 11:57:56.627476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:58:04.813856 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:09.974338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febd82a9-67ad-4920-9b6a-41a68122ebe3 req-63112867-ca49-48aa-b320-db563282ac92 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:09.976124 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-febd82a9-67ad-4920-9b6a-41a68122ebe3 req-63112867-ca49-48aa-b320-db563282ac92 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 945 time: 0.0881693 Nov 11 11:58:10.027092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-3ae579dd-1c3b-4dca-8d9b-0bd16a46ce96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:10.028122 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-febd82a9-67ad-4920-9b6a-41a68122ebe3 req-a85980e0-e009-4a25-8954-669ae6ad161e tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451338 Nov 11 11:58:11.237759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119cac3c-c16f-4422-9d66-e55296f78cc4 req-c9e69d89-5114-4a4a-a29b-93261497aa13 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:11.239399 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-119cac3c-c16f-4422-9d66-e55296f78cc4 req-c9e69d89-5114-4a4a-a29b-93261497aa13 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 945 time: 0.0850399 Nov 11 11:58:11.260379 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:11.291541 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-119cac3c-c16f-4422-9d66-e55296f78cc4 req-176da319-8c73-42de-a450-a90e18fd7b3e tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456555 Nov 11 11:58:11.773012 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-f7659bee-c4d6-4b94-af0f-9490d7ffb1d0 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:11.774605 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-f7659bee-c4d6-4b94-af0f-9490d7ffb1d0 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.60 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 945 time: 0.0840418 Nov 11 11:58:11.847294 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Deleting port 503f62f7-f533-4766-8da8-7233a950f84a {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:58:11.847607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:12.111037 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] For port 503f62f7-f533-4766-8da8-7233a950f84a, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=503f62f7-f533-4766-8da8-7233a950f84a,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:58:12.111394 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:12.464289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Calling delete_port for 503f62f7-f533-4766-8da8-7233a950f84a owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:58:12.614161 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77940f95-e0aa-418f-8be8-be5e820592a1 req-4d53700b-648f-4777-aa22-d38b0690cee1 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:12.615788 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-77940f95-e0aa-418f-8be8-be5e820592a1 req-4d53700b-648f-4777-aa22-d38b0690cee1 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1519220-11ac-4f9a-a744-3f7016e03b44 HTTP/1.1" status: 200 len: 945 time: 0.1585155 Nov 11 11:58:12.704928 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-77940f95-e0aa-418f-8be8-be5e820592a1 req-84f72451-54c9-4d4b-97fd-786c58b36b9a tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822585 Nov 11 11:58:12.763082 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:12.770322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-62d84fb5-32a1-4376-99cb-f22964f70110 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:58:12.775044 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['503f62f7-f533-4766-8da8-7233a950f84a'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:58:12.816116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Pushing event deleted for resources: {'Port': ['ID=503f62f7-f533-4766-8da8-7233a950f84a,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:58:12.818998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:58:12.895798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] No DVR routers for this DVR port 503f62f7-f533-4766-8da8-7233a950f84a on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:58:12.898424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:12.903242 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1519220-11ac-4f9a-a744-3f7016e03b44', 'name': 'network-vif-deleted', 'tag': '503f62f7-f533-4766-8da8-7233a950f84a'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:58:12.958348 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e00d8171-3ecb-4297-bd33-6cf4fb24facf req-28f0c37f-16d0-4e8e-8bd2-fdfe7f7d3252 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.60 "DELETE /v2.0/ports/503f62f7-f533-4766-8da8-7233a950f84a HTTP/1.1" status: 204 len: 173 time: 1.1785295 Nov 11 11:58:12.960625 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1519220-11ac-4f9a-a744-3f7016e03b44', 'name': 'network-vif-deleted', 'tag': '503f62f7-f533-4766-8da8-7233a950f84a', 'status': 'completed', 'code': 200} Nov 11 11:58:13.489026 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6849763b-b400-4f5e-87d0-09ac52bb9eb2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:13.560132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:14.716728 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:16.801073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 503f62f7-f533-4766-8da8-7233a950f84a no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:58:16.835862 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 503f62f7-f533-4766-8da8-7233a950f84a {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:58:16.836260 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 503f62f7-f533-4766-8da8-7233a950f84a not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:58:26.413696 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-b496c3cd-e52a-430c-a984-f4aff894ac36 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0771222 Nov 11 11:58:26.592376 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-b6d11fa1-b301-4ffe-aaa6-8811f5e67a1f service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.0904689 Nov 11 11:58:26.908274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-55b1dec3-2c30-4ea6-b397-40711f523564 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:26.909881 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-55b1dec3-2c30-4ea6-b397-40711f523564 service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.2966957 Nov 11 11:58:27.013421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7595bd13-301f-4403-9170-309aa67ff4ed req-8605ca1b-f525-434b-8af6-23ab1df804de tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:27.014979 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-8605ca1b-f525-434b-8af6-23ab1df804de tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/networks?id=573e3e39-f87a-4728-9797-ba0f2cdaf07a HTTP/1.1" status: 200 len: 814 time: 0.3053720 Nov 11 11:58:27.055011 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-e23b941f-dd3d-4e7e-b3c1-92ef8ff3d490 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/quotas/43c0382884ff4a219b96f50bc6fb1e32 HTTP/1.1" status: 200 len: 375 time: 0.0276670 Nov 11 11:58:27.056951 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-77f77c8a-8c69-4af4-8891-0110f2a6fa45 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 1001 time: 0.1399896 Nov 11 11:58:27.146393 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7595bd13-301f-4403-9170-309aa67ff4ed req-81c4de82-b972-4884-b3e0-ec95a2005280 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Synchronizing usage tracker for tenant:43c0382884ff4a219b96f50bc6fb1e32 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:58:27.197780 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-bdef2037-3101-4ef1-939e-fabadcbd73e3 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:27.197780 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-bdef2037-3101-4ef1-939e-fabadcbd73e3 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0950789 Nov 11 11:58:27.238615 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7595bd13-301f-4403-9170-309aa67ff4ed req-81c4de82-b972-4884-b3e0-ec95a2005280 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Unset dirty status for tenant:43c0382884ff4a219b96f50bc6fb1e32 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:58:27.240027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-81c4de82-b972-4884-b3e0-ec95a2005280 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1785586 Nov 11 11:58:27.284330 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-b91088ed-45b4-4e73-9376-c64a32854324 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0829763 Nov 11 11:58:27.549984 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-64d5b443-1a61-48e9-8339-004008be0401 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2594135 Nov 11 11:58:27.560576 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-27d3ba0d-ca44-4005-836e-3480ecc73079 service neutron] 10.222.0.11 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3119328 Nov 11 11:58:27.821275 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ba0b6b31-0bb4-47fa-af16-3b593d78419a req-122d698f-114c-4d6a-ac41-aa89b59b7598 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2636445 Nov 11 11:58:27.823213 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-eef5b6a5-3efe-4f4d-bc56-2a48e3a6447e service neutron] 10.222.0.11 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2413342 Nov 11 11:58:28.048877 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fae709bc-5afd-4cc2-8236-ea7121404df6 req-940a3120-2317-429e-a3b9-b15f968646bd tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 210 time: 0.0501642 Nov 11 11:58:29.239330 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-9dc300ea-f08e-4026-8b4e-5453b525bbd9 req-152b090a-edde-4e4d-a5ba-997648674e27 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 210 time: 0.0466783 Nov 11 11:58:29.637729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7595bd13-301f-4403-9170-309aa67ff4ed req-ffdfb318-034b-4303-8213-adc2c958eb2b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:29.639367 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-ffdfb318-034b-4303-8213-adc2c958eb2b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.60 "GET /v2.0/networks?id=573e3e39-f87a-4728-9797-ba0f2cdaf07a HTTP/1.1" status: 200 len: 814 time: 0.1689630 Nov 11 11:58:29.655864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Request body: {'port': {'device_id': 'bfb7574e-f181-4951-ae09-a86d315d9a2b', 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a', 'admin_state_up': True, 'tenant_id': '43c0382884ff4a219b96f50bc6fb1e32'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:58:29.809240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Nov 11 11:58:29.820324 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.quota.driver [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88329) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Nov 11 11:58:29.867380 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Made reservation on behalf of 43c0382884ff4a219b96f50bc6fb1e32 for: {'port': 1} {{(pid=88329) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Nov 11 11:58:29.872991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:30.053281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_common [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Allocated IP 172.20.0.7 (573e3e39-f87a-4728-9797-ba0f2cdaf07a/cc8dffe4-8474-48ed-be47-5f9462fe407d/669b7cdc-7daa-4405-a732-0df642984afa) {{(pid=88329) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:137}} Nov 11 11:58:30.441804 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-97b17ef5-8068-410c-9169-c5aa10b840b7 req-98c52825-7224-4c93-92c8-6a68b017fd78 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 210 time: 0.0645328 Nov 11 11:58:30.458912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks [] for port, precommit_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:30.531275 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363305364688312', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_create {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:30.538146 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-81ba689d-4c75-43fb-81bd-6e56876ae65d tempest-VolumesNegativeTest-83784423 tempest-VolumesNegativeTest-83784423-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:58:30.614467 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Network 573e3e39-f87a-4728-9797-ba0f2cdaf07a is already hosted by enough agents. {{(pid=88329) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Nov 11 11:58:30.618426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.base_scheduler [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Resources bound (agent type, host, resource id): {{(pid=88329) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:60}} Nov 11 11:58:30.623883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Received port after_create {{(pid=88329) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Nov 11 11:58:30.650405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Pushing event updated for resources: {'Port': ['ID=669b7cdc-7daa-4405-a732-0df642984afa,revision_number=1']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:58:30.656136 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:58:30.689870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:30.690533 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:30.747019 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-5ce615a2-bc98-48dc-8916-6b870ebe332f tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.60 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0955429 Nov 11 11:58:30.759207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.v2.base [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Request body: {'port': {'device_id': 'bfb7574e-f181-4951-ae09-a86d315d9a2b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81741'}} {{(pid=88329) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 11 11:58:30.877680 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:31.235990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 669b7cdc-7daa-4405-a732-0df642984afa {{(pid=88329) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:58:31.243463 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:31.258704 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Transition to ACTIVE for port object 669b7cdc-7daa-4405-a732-0df642984afa will not be triggered until provisioned by entity L2. {{(pid=88329) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Nov 11 11:58:31.301693 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:31.306413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-55f84066-b59c-43fe-a2a8-5c4596f5ea30 tempest-AttachVolumeNegativeTest-1123203333 tempest-AttachVolumeNegativeTest-1123203333-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:58:31.705483 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Pushing event updated for resources: {'Port': ['ID=669b7cdc-7daa-4405-a732-0df642984afa,revision_number=2']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:58:31.709955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.403s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:58:31.830950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7631f4ef-f18e-4e9a-b312-978784f32d2f req-82eb40db-b199-4d0a-aab8-5321ea271bb8 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:31.831698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7631f4ef-f18e-4e9a-b312-978784f32d2f req-82eb40db-b199-4d0a-aab8-5321ea271bb8 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Synchronizing usage tracker for tenant:43c0382884ff4a219b96f50bc6fb1e32 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:58:31.863351 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Attempting to bind port 669b7cdc-7daa-4405-a732-0df642984afa on host hv-cinder-81741 for vnic_type normal with profile {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 11:58:31.863735 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Attempting to bind port 669b7cdc-7daa-4405-a732-0df642984afa by drivers openvswitch,hyperv on host hv-cinder-81741 at level 0 using segments [{'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Nov 11 11:58:31.864111 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Attempting to bind port 669b7cdc-7daa-4405-a732-0df642984afa on network 573e3e39-f87a-4728-9797-ba0f2cdaf07a {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:58:31.871945 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Port 669b7cdc-7daa-4405-a732-0df642984afa on network 573e3e39-f87a-4728-9797-ba0f2cdaf07a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81741 {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 11 11:58:31.872315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Attempting to bind port 669b7cdc-7daa-4405-a732-0df642984afa on network 573e3e39-f87a-4728-9797-ba0f2cdaf07a {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:90}} Nov 11 11:58:31.879172 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Checking agent: {'id': '46b6cce4-20cf-4dc0-af70-ac89a5609c29', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81741', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'started_at': datetime.datetime(2021, 11, 11, 11, 38, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 11, 58, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:106}} Nov 11 11:58:31.884132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Checking segment: {'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88329) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Nov 11 11:58:31.884132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Bound using segment: {'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'} {{(pid=88329) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:116}} Nov 11 11:58:31.884132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.managers [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Bound port: 669b7cdc-7daa-4405-a732-0df642984afa, host: hv-cinder-81741, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '588e590a-28f1-4341-aa2d-7001b9630355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1009, 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a'}}] {{(pid=88329) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Nov 11 11:58:31.884132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:31.902493 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-7631f4ef-f18e-4e9a-b312-978784f32d2f req-82eb40db-b199-4d0a-aab8-5321ea271bb8 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Unset dirty status for tenant:43c0382884ff4a219b96f50bc6fb1e32 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:58:31.903855 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7631f4ef-f18e-4e9a-b312-978784f32d2f req-82eb40db-b199-4d0a-aab8-5321ea271bb8 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 943 time: 0.2681766 Nov 11 11:58:32.016431 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7631f4ef-f18e-4e9a-b312-978784f32d2f req-96869cb0-2cf9-4e7b-af77-7e38d2e69345 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879843 Nov 11 11:58:32.020545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] For port 669b7cdc-7daa-4405-a732-0df642984afa, host hv-cinder-81741, cleared binding levels {{(pid=88329) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:91}} Nov 11 11:58:32.024009 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] For port 669b7cdc-7daa-4405-a732-0df642984afa, host hv-cinder-81741, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=669b7cdc-7daa-4405-a732-0df642984afa,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88329) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:64}} Nov 11 11:58:32.051130 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated--9223372036852055735'] for port, after_update {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:32.056094 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-3adb4249-4dd9-480a-ba16-80a91936d513 tempest-VolumesActionsTest-373700148 tempest-VolumesActionsTest-373700148-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:58:32.122840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:32.124351 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] 10.222.0.60 "PUT /v2.0/ports/669b7cdc-7daa-4405-a732-0df642984afa HTTP/1.1" status: 200 len: 1093 time: 1.3705277 Nov 11 11:58:32.124892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bfb7574e-f181-4951-ae09-a86d315d9a2b', 'tag': '669b7cdc-7daa-4405-a732-0df642984afa'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:58:32.147637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Pushing event updated for resources: {'Port': ['ID=669b7cdc-7daa-4405-a732-0df642984afa,revision_number=3']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:58:32.147637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:58:32.182005 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bfb7574e-f181-4951-ae09-a86d315d9a2b', 'tag': '669b7cdc-7daa-4405-a732-0df642984afa', 'status': 'completed', 'code': 200} Nov 11 11:58:32.280134 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ffca94e6-2219-4c18-be4c-192a796165a3 req-f47059f0-bc83-4375-b47a-4b5f8f1a11d3 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 1096 time: 0.0773361 Nov 11 11:58:32.436565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffca94e6-2219-4c18-be4c-192a796165a3 req-6ce0a2d8-1951-479e-a419-16288aa9b4cf service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:32.438071 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ffca94e6-2219-4c18-be4c-192a796165a3 req-6ce0a2d8-1951-479e-a419-16288aa9b4cf service neutron] 10.222.0.60 "GET /v2.0/networks?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1507041 Nov 11 11:58:32.595128 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffca94e6-2219-4c18-be4c-192a796165a3 req-25effcd6-e563-4495-ad75-115276a74bb7 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:32.596784 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ffca94e6-2219-4c18-be4c-192a796165a3 req-25effcd6-e563-4495-ad75-115276a74bb7 service neutron] 10.222.0.60 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1459982 Nov 11 11:58:32.711341 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-f02cc10f-7c09-41da-8ae5-b04b722a405f service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 1096 time: 0.0760677 Nov 11 11:58:32.794329 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-f7c96aee-0f8f-402a-93f3-c9ca76cbb283 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=669b7cdc-7daa-4405-a732-0df642984afa HTTP/1.1" status: 200 len: 217 time: 0.0740352 Nov 11 11:58:32.864366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7595bd13-301f-4403-9170-309aa67ff4ed req-b52de54d-86f8-4643-b94b-493f29740ba4 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:32.865945 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-b52de54d-86f8-4643-b94b-493f29740ba4 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=cc8dffe4-8474-48ed-be47-5f9462fe407d HTTP/1.1" status: 200 len: 854 time: 0.0658333 Nov 11 11:58:32.919610 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-e95d0b9c-e6e4-4a32-9d72-83d3ec90366f service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=573e3e39-f87a-4728-9797-ba0f2cdaf07a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0471349 Nov 11 11:58:33.067405 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-31ea11d8-58dd-4152-8254-1460669cd706 service neutron] 10.222.0.60 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1416523 Nov 11 11:58:33.266136 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-7595bd13-301f-4403-9170-309aa67ff4ed req-bb37719c-56e9-4b65-a9e8-ace21f15f0c6 service neutron] 10.222.0.60 "GET /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1929290 Nov 11 11:58:33.287790 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3b033d-6a84-4820-aa2c-0ad011b66a9f req-15d0ccc1-b366-4594-b809-7f8f742f986b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:33.289412 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8e3b033d-6a84-4820-aa2c-0ad011b66a9f req-15d0ccc1-b366-4594-b809-7f8f742f986b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 943 time: 0.1288226 Nov 11 11:58:33.341520 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8e3b033d-6a84-4820-aa2c-0ad011b66a9f req-bbc57841-b230-4a3d-aeec-f4f1676bf39d tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452027 Nov 11 11:58:33.629016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:58:34.562403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5949a6da-c59d-4d82-a5d3-8f6e2e9fdd1c req-a4630746-95a8-405d-bfc8-10bd6388a644 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:34.564235 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5949a6da-c59d-4d82-a5d3-8f6e2e9fdd1c req-a4630746-95a8-405d-bfc8-10bd6388a644 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 943 time: 0.0961719 Nov 11 11:58:34.615940 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5949a6da-c59d-4d82-a5d3-8f6e2e9fdd1c req-d164af67-473a-411c-8a5d-bfbdc8b156ba tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450580 Nov 11 11:58:34.850603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:35.837703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-347dc547-5af2-4f4c-b559-50d168edcfbe req-6085f168-8295-4e2a-a0af-82aba797ac88 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:35.839386 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-347dc547-5af2-4f4c-b559-50d168edcfbe req-6085f168-8295-4e2a-a0af-82aba797ac88 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 943 time: 0.0916507 Nov 11 11:58:35.901895 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-347dc547-5af2-4f4c-b559-50d168edcfbe req-b10848fa-e34b-437f-ae5e-d747d12e8846 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546176 Nov 11 11:58:36.224833 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 669b7cdc-7daa-4405-a732-0df642984afa details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 11:58:36.378649 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 669b7cdc-7daa-4405-a732-0df642984afa, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=669b7cdc-7daa-4405-a732-0df642984afa,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:58:36.394990 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '669b7cdc-7daa-4405-a732-0df642984afa', 'network_id': '573e3e39-f87a-4728-9797-ba0f2cdaf07a', 'port_id': '669b7cdc-7daa-4405-a732-0df642984afa', 'mac_address': 'fa:16:3e:66:f7:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1009, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc8dffe4-8474-48ed-be47-5f9462fe407d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 11:58:36.457064 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:36.484948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 669b7cdc-7daa-4405-a732-0df642984afa {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 11:58:36.493053 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 669b7cdc-7daa-4405-a732-0df642984afa, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=669b7cdc-7daa-4405-a732-0df642984afa,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:58:36.531228 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:36.533226 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:58:36.602738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=669b7cdc-7daa-4405-a732-0df642984afa,revision_number=4']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:58:36.613160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.613501 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.613883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.614272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.614625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.614991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.615386 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.615750 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.616110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.616557 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.616919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:58:36.621096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:58:36.909761 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['669b7cdc-7daa-4405-a732-0df642984afa'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:58:37.173957 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2760ea9-1d54-446f-a1bd-93a86ec95162 req-48099d78-f181-4d94-80a6-57856d30983c tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:37.175726 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a2760ea9-1d54-446f-a1bd-93a86ec95162 req-48099d78-f181-4d94-80a6-57856d30983c tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 944 time: 0.0967376 Nov 11 11:58:37.232342 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a2760ea9-1d54-446f-a1bd-93a86ec95162 req-a3162231-64f9-453f-b331-89a5622662fc tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496368 Nov 11 11:58:38.239878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 669b7cdc-7daa-4405-a732-0df642984afa up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 11:58:38.354245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning for port 669b7cdc-7daa-4405-a732-0df642984afa completed by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Nov 11 11:58:38.364143 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 669b7cdc-7daa-4405-a732-0df642984afa triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 11:58:38.364849 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:38.498065 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:38.503278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90d68a6-70ff-4f34-b0fa-7f006a71821b req-4235b92c-2cf0-492c-9ed2-86eda066c20a tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:38.506133 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a90d68a6-70ff-4f34-b0fa-7f006a71821b req-4235b92c-2cf0-492c-9ed2-86eda066c20a tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 944 time: 0.1276028 Nov 11 11:58:38.538063 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bfb7574e-f181-4951-ae09-a86d315d9a2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '669b7cdc-7daa-4405-a732-0df642984afa'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:58:38.558375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 669b7cdc-7daa-4405-a732-0df642984afa, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=669b7cdc-7daa-4405-a732-0df642984afa,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:58:38.570110 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a90d68a6-70ff-4f34-b0fa-7f006a71821b req-0f55c605-8fa7-4d31-bcfe-34a0633d0125 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519996 Nov 11 11:58:38.588685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:38.596116 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:58:38.670342 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=669b7cdc-7daa-4405-a732-0df642984afa,revision_number=5']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:58:38.673777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:58:38.688901 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bfb7574e-f181-4951-ae09-a86d315d9a2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '669b7cdc-7daa-4405-a732-0df642984afa', 'code': 200} Nov 11 11:58:39.009944 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd301db6-35f8-4e64-897f-73f74d186d04 req-4f6a87f5-1fab-499b-8152-51dee0611b4a service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 1098 time: 0.0804439 Nov 11 11:58:39.058394 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-bd301db6-35f8-4e64-897f-73f74d186d04 req-f89075dc-bd88-4da0-ac26-42486bed8673 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424211 Nov 11 11:58:39.779398 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97de7e5-8f3b-40e7-9682-1c51ba8f52f2 req-acc004c2-5eb3-4624-83f9-b933f21228ac tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:39.781077 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e97de7e5-8f3b-40e7-9682-1c51ba8f52f2 req-acc004c2-5eb3-4624-83f9-b933f21228ac tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 945 time: 0.0908930 Nov 11 11:58:39.837134 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e97de7e5-8f3b-40e7-9682-1c51ba8f52f2 req-45f985e7-e4f4-43b2-b5db-6d2c2df3d545 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464482 Nov 11 11:58:40.043747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a4183100-5fbe-41a8-bb9d-7439601fc341 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:41.055823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad8755a-f982-475f-acfe-761dd9716bf3 req-3abd3eeb-727a-4cbe-a82d-1416af34e2ba tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:58:41.057525 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2ad8755a-f982-475f-acfe-761dd9716bf3 req-3abd3eeb-727a-4cbe-a82d-1416af34e2ba tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 945 time: 0.0870311 Nov 11 11:58:41.108546 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-2ad8755a-f982-475f-acfe-761dd9716bf3 req-60d30f53-1fd1-4c49-bbb7-7d6ddc9f21bd tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443664 Nov 11 11:58:41.268518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:43.485708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7bdba8c8-ec1f-4bb6-99cc-9c5bea4f1f2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:43.554312 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:58:44.712546 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:04.865085 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:06.741234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff4346b-26ca-438d-b783-c0a723bc8e71 req-ce92795e-7c51-41e3-8693-c2ff18e70e7a tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:59:06.742903 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fff4346b-26ca-438d-b783-c0a723bc8e71 req-ce92795e-7c51-41e3-8693-c2ff18e70e7a tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 945 time: 0.0917008 Nov 11 11:59:06.794506 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-fff4346b-26ca-438d-b783-c0a723bc8e71 req-933df5b2-91a5-4dfb-8969-ce99c5b46ec2 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450985 Nov 11 11:59:08.031236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c413088f-aa1d-4def-a27c-b6ca82ec500c req-ddaf1dec-6a64-4805-adbe-94fe021d10e2 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:59:08.033318 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c413088f-aa1d-4def-a27c-b6ca82ec500c req-ddaf1dec-6a64-4805-adbe-94fe021d10e2 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 945 time: 0.0977840 Nov 11 11:59:08.097878 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c413088f-aa1d-4def-a27c-b6ca82ec500c req-93e4473c-39e9-4867-9be5-35d9598ad45b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583079 Nov 11 11:59:08.729946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-a2cee617-3020-41c6-9548-cb6434afc87d tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:59:08.731627 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-a2cee617-3020-41c6-9548-cb6434afc87d tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.60 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 945 time: 0.0856023 Nov 11 11:59:08.809078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Deleting port 669b7cdc-7daa-4405-a732-0df642984afa {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 11:59:08.809477 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:09.084789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] For port 669b7cdc-7daa-4405-a732-0df642984afa, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=669b7cdc-7daa-4405-a732-0df642984afa,segment=NetworkSegment(588e590a-28f1-4341-aa2d-7001b9630355),segment_id=588e590a-28f1-4341-aa2d-7001b9630355)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 11:59:09.085440 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:09.218214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Calling delete_port for 669b7cdc-7daa-4405-a732-0df642984afa owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 11:59:09.372852 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0d6dcd-c0e3-4a34-8a47-a4f2afc4098c req-2e0224a2-5b27-4df2-976b-d2ef252fe49b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:59:09.374478 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ab0d6dcd-c0e3-4a34-8a47-a4f2afc4098c req-2e0224a2-5b27-4df2-976b-d2ef252fe49b tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 945 time: 0.1280768 Nov 11 11:59:09.461301 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ab0d6dcd-c0e3-4a34-8a47-a4f2afc4098c req-071ae55e-a0a0-4c03-83f7-b353e0c916d2 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/security-groups?id=ae210d10-c10a-4a78-ba88-e4f7261ed5b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0805478 Nov 11 11:59:09.519941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:09.528579 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a163f377-3c60-4479-ba69-69ef01d37e82 tempest-TestMinimumBasicScenario-499315120 tempest-TestMinimumBasicScenario-499315120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:59:09.536717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['669b7cdc-7daa-4405-a732-0df642984afa'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 11:59:09.575272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Pushing event deleted for resources: {'Port': ['ID=669b7cdc-7daa-4405-a732-0df642984afa,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:59:09.617506 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.617919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.618306 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.618718 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.619227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.619527 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.619940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.620347 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.620747 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.621153 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.621552 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:09.629056 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:59:09.668389 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] No DVR routers for this DVR port 669b7cdc-7daa-4405-a732-0df642984afa on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 11:59:09.670967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:09.673892 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bfb7574e-f181-4951-ae09-a86d315d9a2b', 'name': 'network-vif-deleted', 'tag': '669b7cdc-7daa-4405-a732-0df642984afa'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 11:59:09.714895 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8835fbce-8ae8-4f96-a6be-314b8d5fd083 req-b1cf2ca4-2709-497b-b71b-dee0a708dec5 tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.60 "DELETE /v2.0/ports/669b7cdc-7daa-4405-a732-0df642984afa HTTP/1.1" status: 204 len: 173 time: 0.9770164 Nov 11 11:59:09.770495 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bfb7574e-f181-4951-ae09-a86d315d9a2b', 'name': 'network-vif-deleted', 'tag': '669b7cdc-7daa-4405-a732-0df642984afa', 'status': 'completed', 'code': 200} Nov 11 11:59:10.350767 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-efaf1554-e7bd-4cf9-8136-f0e6bfcf63e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:10.637193 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 11:59:10.661027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-cd403cb0-c21d-4aa2-aeff-c758203c5991 req-3a032fea-13ed-43ff-a138-ede264e199aa tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Synchronizing usage tracker for tenant:43c0382884ff4a219b96f50bc6fb1e32 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 11:59:10.728161 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-cd403cb0-c21d-4aa2-aeff-c758203c5991 req-3a032fea-13ed-43ff-a138-ede264e199aa tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] Unset dirty status for tenant:43c0382884ff4a219b96f50bc6fb1e32 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 11:59:10.729764 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd403cb0-c21d-4aa2-aeff-c758203c5991 req-3a032fea-13ed-43ff-a138-ede264e199aa tempest-VolumesSnapshotTestJSON-1688622254 tempest-VolumesSnapshotTestJSON-1688622254-project] 10.222.0.11 "GET /v2.0/ports?device_id=bfb7574e-f181-4951-ae09-a86d315d9a2b HTTP/1.1" status: 200 len: 210 time: 0.1167912 Nov 11 11:59:11.275925 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:13.476199 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5bc8b931-d249-4136-bdc6-718e2fe901b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:13.544778 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:14.593104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 669b7cdc-7daa-4405-a732-0df642984afa no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 11:59:14.629654 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 669b7cdc-7daa-4405-a732-0df642984afa {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 11:59:14.630066 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 669b7cdc-7daa-4405-a732-0df642984afa not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 11:59:14.720092 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:28.357348 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-ba7c4798-29e6-4f0d-948a-69f5a524b2ad service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0731666 Nov 11 11:59:28.506466 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-31e792a6-983a-48ce-a819-1cf382293c3a service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.0774798 Nov 11 11:59:28.664861 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-4fba22b8-7e6a-465c-ace6-3965973afde4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:59:28.666367 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-4fba22b8-7e6a-465c-ace6-3965973afde4 service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.1395237 Nov 11 11:59:28.778889 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-f93bef69-7544-456c-ad20-c8e948a5f7ef service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 1001 time: 0.1058941 Nov 11 11:59:29.060926 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-b968ae72-34f2-47b6-8729-89fc4d22c031 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 11:59:29.063208 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-b968ae72-34f2-47b6-8729-89fc4d22c031 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.2785335 Nov 11 11:59:29.147129 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-9a33928b-a98a-4c06-9ecf-36d50f312f51 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0751262 Nov 11 11:59:29.289061 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-4b854369-5ed0-4bc1-9001-4a226478bee1 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1354482 Nov 11 11:59:29.430044 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c4975a29-86f7-454a-a778-17b6d7fa6058 req-207f1008-5f95-4e04-931b-c9736256b10b service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1351247 Nov 11 11:59:34.852343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:40.009740 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-fca2459e-9139-4fd3-88b7-2a4c2e21dc26 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:40.943830 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43074) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:59:41.014100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Deleting subnet cc8dffe4-8474-48ed-be47-5f9462fe407d {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 11:59:41.017961 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.076078 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036850920695'] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.141956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.244535 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2678040', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2638849'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.249561 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8443b863-9bb3-4047-9e2b-6b410a19bca3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:59:41.272364 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.287348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cc8dffe4-8474-48ed-be47-5f9462fe407d,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:59:41.299237 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.303245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.303684 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.304104 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.304520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.304936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.305354 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.305766 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.306178 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.306589 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.307315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.307724 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 11:59:41.312738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:59:41.314742 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-ce531678-aaec-40c2-8b3a-20bf1bc835c0 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/cc8dffe4-8474-48ed-be47-5f9462fe407d HTTP/1.1" status: 204 len: 168 time: 0.3695796 Nov 11 11:59:41.317703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43078) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:59:41.440303 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.574912 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.602511 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['573e3e39-f87a-4728-9797-ba0f2cdaf07a']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:59:41.615585 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '588e590a-28f1-4341-aa2d-7001b9630355') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:59:41.615946 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '588e590a-28f1-4341-aa2d-7001b9630355') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 11:59:41.629507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.645149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.652069 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Releasing vlan 1009 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 11:59:41.652534 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 11:59:41.666591 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 11:59:41.778387 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.783936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-255f76b6-176e-4b82-9419-178e0a757da8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:59:41.798738 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:41.808904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Pushing event deleted for resources: {'Network': ['ID=573e3e39-f87a-4728-9797-ba0f2cdaf07a,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:59:41.812654 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] 10.222.0.11 "DELETE /v2.0/networks/573e3e39-f87a-4728-9797-ba0f2cdaf07a HTTP/1.1" status: 204 len: 168 time: 0.4932501 Nov 11 11:59:41.813578 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5f2ee476-d9b7-47af-ab9f-fc625a7ca7b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:59:42.086278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43084) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:59:42.140027 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-7a67ee12-e870-4436-89e7-7a44ed541234 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=43c0382884ff4a219b96f50bc6fb1e32&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0523570 Nov 11 11:59:42.142613 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43088) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 11:59:42.209302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4d1630f5-98f7-477f-bd26-70d33a34fd2e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:42.237583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4d1630f5-98f7-477f-bd26-70d33a34fd2e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:42.429796 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4d1630f5-98f7-477f-bd26-70d33a34fd2e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:42.435328 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-ea783e7a-5e9f-4ed0-b72f-f622f70b7f91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 11:59:42.449219 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d1630f5-98f7-477f-bd26-70d33a34fd2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae210d10-c10a-4a78-ba88-e4f7261ed5b7,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 11:59:42.452331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4d1630f5-98f7-477f-bd26-70d33a34fd2e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 11:59:42.453708 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-4d1630f5-98f7-477f-bd26-70d33a34fd2e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:42.454938 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-4d1630f5-98f7-477f-bd26-70d33a34fd2e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ae210d10-c10a-4a78-ba88-e4f7261ed5b7 HTTP/1.1" status: 204 len: 168 time: 0.3112988 Nov 11 11:59:43.525749 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d5c27003-6457-4e5a-8b37-7d701289be22 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:43.558166 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:44.800622 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 11:59:47.628132 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:00:04.888568 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:10.014851 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-1563dcab-a09b-45b8-aaac-37a0e57a4287 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:11.245902 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:13.479783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-47e6fed5-0760-4a08-8c17-b3a849e2b4f9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:13.560334 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:14.729625 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:17.209086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-ed0f8a26-28cf-4993-9b4f-41d012c087c2 req-2b06380f-9a2b-4747-bd80-7c14469f3976 service neutron] (88328) timed out ('10.222.0.11', 36816) {{(pid=88328) process_request /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:830}} Nov 11 12:00:24.628165 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:00:26.945916 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-4509b705-f5b2-44e4-af34-864413555035 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0776806 Nov 11 12:00:27.095608 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-2a88056a-4230-4ea9-b019-00c15f02a9b3 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.0772340 Nov 11 12:00:27.253821 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-e8c40810-c0f8-47fe-9cd9-c5d84b0c3ef6 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:27.255954 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-e8c40810-c0f8-47fe-9cd9-c5d84b0c3ef6 service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.1405034 Nov 11 12:00:27.368772 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-6b9c78b3-98f9-4fd2-89e5-1ece4c5ef732 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 1001 time: 0.1066008 Nov 11 12:00:27.439979 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-ce7e0efb-d5cd-44f4-a9be-6d2294869fe1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:27.441553 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-ce7e0efb-d5cd-44f4-a9be-6d2294869fe1 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0653985 Nov 11 12:00:27.525168 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-0c057958-a538-48cb-99aa-52901c7de15b service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0771997 Nov 11 12:00:27.667083 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-a10eb29f-3810-4751-a967-5f28fe5929cb service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1350594 Nov 11 12:00:27.816190 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-18c3c3c7-8304-41d0-93dc-e3794755fd98 req-c1c81ed5-1d39-42be-89e3-c4502d5e58d1 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1423304 Nov 11 12:00:30.216248 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a9e4360-5965-45d8-b553-eafed6601c3e req-6b61b8fb-aac7-4228-b02d-3555973f9aaa tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:30.217840 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8a9e4360-5965-45d8-b553-eafed6601c3e req-6b61b8fb-aac7-4228-b02d-3555973f9aaa tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0816040 Nov 11 12:00:30.266589 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8a9e4360-5965-45d8-b553-eafed6601c3e req-92a91f71-a1d5-4bd7-9eae-68aa098f40c3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0423419 Nov 11 12:00:31.484521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d13c24-42aa-43fd-84f9-a3b2197747af req-72099672-6a40-4be1-a9c8-480ed992a560 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:31.486102 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-56d13c24-42aa-43fd-84f9-a3b2197747af req-72099672-6a40-4be1-a9c8-480ed992a560 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0876005 Nov 11 12:00:31.535016 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-56d13c24-42aa-43fd-84f9-a3b2197747af req-ee572b36-cc99-44b4-adbc-66a6ea12f7cf tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0426676 Nov 11 12:00:32.746070 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4f4c8-ca2a-4ee1-8391-068603098a20 req-e40ab127-1f77-426b-88b1-1c62525d6e0f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:32.747693 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0b4f4c8-ca2a-4ee1-8391-068603098a20 req-e40ab127-1f77-426b-88b1-1c62525d6e0f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0840898 Nov 11 12:00:32.800477 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b0b4f4c8-ca2a-4ee1-8391-068603098a20 req-089ce930-1ac2-4e11-b767-bb1f70274b34 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0466826 Nov 11 12:00:34.265637 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fa1464-af5c-4dd0-b1e3-ed964c714ef1 req-0c257052-e2b9-4749-ab68-f9ea22621d23 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:34.267290 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73fa1464-af5c-4dd0-b1e3-ed964c714ef1 req-0c257052-e2b9-4749-ab68-f9ea22621d23 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.3435724 Nov 11 12:00:34.315320 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-73fa1464-af5c-4dd0-b1e3-ed964c714ef1 req-0ebc26da-5330-4958-846c-c6e1c843aaf0 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0418959 Nov 11 12:00:34.901813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:35.523887 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def27b36-bfdf-4253-b163-0ddb8486d09d req-749d4eb3-1b88-4653-915d-847f5cb212c1 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:35.525630 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-def27b36-bfdf-4253-b163-0ddb8486d09d req-749d4eb3-1b88-4653-915d-847f5cb212c1 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0880580 Nov 11 12:00:35.576155 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-def27b36-bfdf-4253-b163-0ddb8486d09d req-e9cf4562-3a8c-490d-a6db-9ecee0da2848 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0438080 Nov 11 12:00:36.806444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b6cc5b7-0bf3-480d-9280-d98159a3c598 req-7259fd27-94ed-443f-91d1-68709ad19eff tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:36.808054 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b6cc5b7-0bf3-480d-9280-d98159a3c598 req-7259fd27-94ed-443f-91d1-68709ad19eff tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0824301 Nov 11 12:00:36.856196 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b6cc5b7-0bf3-480d-9280-d98159a3c598 req-81329c97-861a-47e1-8883-fe471ef24ee6 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0415597 Nov 11 12:00:38.148577 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169ac271-815b-4bf8-9f65-33a6dbb38be1 req-5cd2d17d-9886-49ce-a184-54f60142fcd1 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:38.150086 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-169ac271-815b-4bf8-9f65-33a6dbb38be1 req-5cd2d17d-9886-49ce-a184-54f60142fcd1 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.1713626 Nov 11 12:00:38.198166 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-169ac271-815b-4bf8-9f65-33a6dbb38be1 req-ba925c5e-64b2-4102-beee-7695e0b6da6c tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0417695 Nov 11 12:00:39.408272 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca96eb75-2ee9-44db-8745-018ddfca1bbc req-beb00f63-0d20-4cd2-ba49-be9289f66f79 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:39.409885 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ca96eb75-2ee9-44db-8745-018ddfca1bbc req-beb00f63-0d20-4cd2-ba49-be9289f66f79 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0862830 Nov 11 12:00:39.457954 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-ca96eb75-2ee9-44db-8745-018ddfca1bbc req-d64b25e2-8a92-4b6e-aa5f-1936b1902332 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0412011 Nov 11 12:00:40.016375 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-78c16fba-289a-498b-9ebb-9435cbf88493 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:40.347879 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-b8ab1672-4b2d-4492-b0ae-90792fa38fb5 service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.0777190 Nov 11 12:00:40.488031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-6ad0ab73-2e49-4eb7-bcd9-8addd1ee27de service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:40.489609 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-6ad0ab73-2e49-4eb7-bcd9-8addd1ee27de service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.1355848 Nov 11 12:00:40.639122 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-3172588f-71a5-4a9f-abb5-cdb151a280f4 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 1001 time: 0.1430931 Nov 11 12:00:40.723214 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-2655594d-ae1a-40b4-9e35-4c3e75abf44a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:40.724739 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-2655594d-ae1a-40b4-9e35-4c3e75abf44a service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0780599 Nov 11 12:00:40.737891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b927eec1-180e-4442-acc9-05d937056417 req-acfb2504-ddb9-4e71-b3e2-5958761e96ee tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:40.739412 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b927eec1-180e-4442-acc9-05d937056417 req-acfb2504-ddb9-4e71-b3e2-5958761e96ee tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.1529670 Nov 11 12:00:40.842249 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b927eec1-180e-4442-acc9-05d937056417 req-e7d7fbf4-52e0-49fa-ba8d-3384fd18359c tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0669603 Nov 11 12:00:40.859308 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-2ba6f065-3a14-4aa2-968c-1f13e7d32a62 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1275837 Nov 11 12:00:40.869402 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-ff1ffdc1-7483-4255-b478-b787fda99898 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=88329) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 12:00:40.870438 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-ff1ffdc1-7483-4255-b478-b787fda99898 service neutron] 10.222.0.60 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12161 time: 0.0052640 Nov 11 12:00:41.016085 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-2c695048-0cef-4d68-ab86-5b7433c83ff7 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1378505 Nov 11 12:00:41.160531 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a8ad00fb-44b7-4222-b563-a12e0ebd404b req-0b4729c6-fa98-4071-bdb6-9983ab505796 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1382239 Nov 11 12:00:41.264883 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:42.053894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c547099b-eee1-4686-8836-d39d8c7af492 req-7b44be43-439c-4c9c-a30c-40416d22b9ae tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:42.055606 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c547099b-eee1-4686-8836-d39d8c7af492 req-7b44be43-439c-4c9c-a30c-40416d22b9ae tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0858531 Nov 11 12:00:42.109981 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-c547099b-eee1-4686-8836-d39d8c7af492 req-1087c8cd-2e0b-4a6a-9cdc-0de347f024ec tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0480249 Nov 11 12:00:43.328355 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13cf80e4-0f0d-4289-b33c-7d668bba65a5 req-da915c17-154b-415d-b9cb-658503e02a38 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:43.329999 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13cf80e4-0f0d-4289-b33c-7d668bba65a5 req-da915c17-154b-415d-b9cb-658503e02a38 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0908999 Nov 11 12:00:43.393210 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-13cf80e4-0f0d-4289-b33c-7d668bba65a5 req-639a8cd7-a8b5-4818-99ec-d19874905946 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0523901 Nov 11 12:00:43.568016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a2ca8523-42c6-4c27-878f-aa124914030c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:43.610666 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:44.611820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7595e4d-c724-4c87-afcc-80f29fa97248 req-0b17881c-42de-48fd-a069-b89a684535f7 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:44.614045 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d7595e4d-c724-4c87-afcc-80f29fa97248 req-0b17881c-42de-48fd-a069-b89a684535f7 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0903089 Nov 11 12:00:44.674145 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d7595e4d-c724-4c87-afcc-80f29fa97248 req-2bb5f094-d624-4a8e-bbb0-7e8e23d83d7f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0459571 Nov 11 12:00:44.728154 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:44.912114 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-d606df1b-3cb4-4334-adeb-d966d4058db7 req-060feed2-b4ff-4ea6-a7bd-17701f9cdbf5 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0862234 Nov 11 12:00:45.346397 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edde2df-e240-400f-8033-3b2108e58dab req-8fdfb8c1-56ad-4ccf-b5a9-9db82557ee0b tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:45.349437 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3edde2df-e240-400f-8033-3b2108e58dab req-8fdfb8c1-56ad-4ccf-b5a9-9db82557ee0b tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.1141672 Nov 11 12:00:45.360650 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-217b8d1a-e7bd-4fce-8937-2fa8a451684b service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1864464 Nov 11 12:00:45.408453 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3edde2df-e240-400f-8033-3b2108e58dab req-8b8c3914-eb40-4ac2-84e8-6fd708fc2b52 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0518157 Nov 11 12:00:46.632122 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15df88cc-f066-45c0-bb96-efae3badb4dc req-3cb4c6e2-6a57-44e9-8fc2-6597c298cca3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:46.634395 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-15df88cc-f066-45c0-bb96-efae3badb4dc req-3cb4c6e2-6a57-44e9-8fc2-6597c298cca3 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0916123 Nov 11 12:00:46.687133 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-15df88cc-f066-45c0-bb96-efae3badb4dc req-bce4907c-a4ad-40bb-9741-71f2147cf538 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0459306 Nov 11 12:00:46.885792 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 16de7b1f-2577-472b-b6f9-54cb9aca54c2 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 12:00:46.943424 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-2fa94ff6-fa1c-41a2-ac5f-1646dda5ba59 service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4&tenant_id=5d0ef0fa307d43119524263d91d2b2e4 HTTP/1.1" status: 200 len: 1098 time: 0.0810812 Nov 11 12:00:47.004659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:47.037768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 12:00:47.044119 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-a601a6ac-a8ae-482e-972b-4fea83ecda1f service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.0788183 Nov 11 12:00:47.051871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:00:47.097671 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:47.103588 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-bcc6c7f2-c3e4-48ae-8a65-ae0f49301002 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:00:47.192517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=6']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:00:47.202717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.203227 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.203513 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.203907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.204262 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.204647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.205029 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.205407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.205784 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.206163 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.206537 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88330) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:00:47.211197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:00:47.247090 dv-cinder-817417-1-iscsi neutron-server[88215]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'code': 422} returned with failed status Nov 11 12:00:47.423582 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b334b99-7874-402e-8ba2-4f32667c088a req-e3896d0c-31ca-4747-85e4-b0a244a03feb service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:47.425242 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-e3896d0c-31ca-4747-85e4-b0a244a03feb service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.3740647 Nov 11 12:00:47.541517 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-a1297c99-33ca-4c43-80d5-50f9942e492e service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 999 time: 0.1094451 Nov 11 12:00:47.614620 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b334b99-7874-402e-8ba2-4f32667c088a req-e126e0f8-3eba-4a22-b1bc-e96ba60e6ce7 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:47.616235 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-e126e0f8-3eba-4a22-b1bc-e96ba60e6ce7 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0682361 Nov 11 12:00:47.706481 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-aafd36f8-36e0-424f-aab0-511b6cd2dd5a service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0835829 Nov 11 12:00:47.915140 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-1558cc32-8231-4b88-9a25-b2fa0522ef63 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2020853 Nov 11 12:00:47.979019 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60483e6-e881-418e-a1a8-78876b2bdf5b req-87435bda-e167-4559-8522-6d36cee19dde tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:47.980647 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e60483e6-e881-418e-a1a8-78876b2bdf5b req-87435bda-e167-4559-8522-6d36cee19dde tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.1528933 Nov 11 12:00:48.124908 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e60483e6-e881-418e-a1a8-78876b2bdf5b req-1394218c-e5c9-4e61-979d-58a05c848ce2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0936131 Nov 11 12:00:48.128425 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-0b334b99-7874-402e-8ba2-4f32667c088a req-94d83d78-1272-4d1f-a745-3bedfe703a15 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2033675 Nov 11 12:00:49.334090 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92a6a10-49f6-421b-a17a-aefc76622d69 req-59f964d6-f37f-4352-b9f9-d5671227a218 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:49.335644 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b92a6a10-49f6-421b-a17a-aefc76622d69 req-59f964d6-f37f-4352-b9f9-d5671227a218 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0855567 Nov 11 12:00:49.386084 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b92a6a10-49f6-421b-a17a-aefc76622d69 req-3b04fa05-832d-45d8-8851-1490ac94daeb tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0440814 Nov 11 12:00:50.601268 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1d1d42-850e-4f59-ae1a-ff4af30cf2fe req-067cf62e-4f37-4c20-beae-b135c398e479 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:50.602887 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db1d1d42-850e-4f59-ae1a-ff4af30cf2fe req-067cf62e-4f37-4c20-beae-b135c398e479 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0896068 Nov 11 12:00:50.652997 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-db1d1d42-850e-4f59-ae1a-ff4af30cf2fe req-54c7440b-0779-4600-8ae9-694e65a3a320 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0438712 Nov 11 12:00:51.865412 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3fb19d6-2a52-4a91-9826-d8c6a98d33ab req-3168ecf4-c7ef-439c-94e8-5f820f9b0d5f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:51.867023 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a3fb19d6-2a52-4a91-9826-d8c6a98d33ab req-3168ecf4-c7ef-439c-94e8-5f820f9b0d5f tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0849271 Nov 11 12:00:51.917015 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-a3fb19d6-2a52-4a91-9826-d8c6a98d33ab req-3a66f40e-ba5e-4c83-9f6d-8509d8059495 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0438008 Nov 11 12:00:53.128234 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4984024b-86ee-472c-99cc-def1225e5cfa req-5137fc73-4a2b-4b28-8ff1-ad9f9272836b tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:53.129852 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4984024b-86ee-472c-99cc-def1225e5cfa req-5137fc73-4a2b-4b28-8ff1-ad9f9272836b tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0872772 Nov 11 12:00:53.180229 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4984024b-86ee-472c-99cc-def1225e5cfa req-0ab4beeb-a626-475b-bef0-54a244065878 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0439425 Nov 11 12:00:54.390763 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d29f9d2-7fc7-43ad-b39b-e0c48b9d1244 req-bd531791-c5ed-46a3-8f05-73dfacc0d01e tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:54.392436 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4d29f9d2-7fc7-43ad-b39b-e0c48b9d1244 req-bd531791-c5ed-46a3-8f05-73dfacc0d01e tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0866075 Nov 11 12:00:54.444922 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4d29f9d2-7fc7-43ad-b39b-e0c48b9d1244 req-c4ef6156-c7ae-4419-92c0-6b6b9b932dae tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0463459 Nov 11 12:00:55.718988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01950b15-6d51-46d5-a15b-117895942d91 req-edcba7ac-2ecf-4ec7-bc73-529e5e3db501 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:55.720693 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01950b15-6d51-46d5-a15b-117895942d91 req-edcba7ac-2ecf-4ec7-bc73-529e5e3db501 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.1434362 Nov 11 12:00:55.731296 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f6407627-3ad1-4699-a263-cdbc3da94caa req-06a4bd51-d793-40bb-9720-8708edb247ff service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1096 time: 0.1079159 Nov 11 12:00:55.808136 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-01950b15-6d51-46d5-a15b-117895942d91 req-d4b4c92b-49e3-4395-9e72-a46676b815cc tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0803273 Nov 11 12:00:55.814905 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-f6407627-3ad1-4699-a263-cdbc3da94caa req-2f33b56a-2d90-4614-83d7-5a62ef961c14 service neutron] 10.222.0.60 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0641744 Nov 11 12:00:57.027112 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d56cbab-f595-42c2-894c-59d96938e6ed req-e6965955-8cd0-46ad-b671-5c271c9f9d52 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:57.028759 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4d56cbab-f595-42c2-894c-59d96938e6ed req-e6965955-8cd0-46ad-b671-5c271c9f9d52 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0955400 Nov 11 12:00:57.079603 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-4d56cbab-f595-42c2-894c-59d96938e6ed req-f1b1cc54-5105-42ab-9d9c-b6b7dae3127c tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0444863 Nov 11 12:00:58.301464 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a39c504-949e-4f93-bc5c-1abb69787700 req-1c82afc9-2cde-40f6-9d45-d16e9c66ca30 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:00:58.303112 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3a39c504-949e-4f93-bc5c-1abb69787700 req-1c82afc9-2cde-40f6-9d45-d16e9c66ca30 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 943 time: 0.0879772 Nov 11 12:00:58.352906 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-3a39c504-949e-4f93-bc5c-1abb69787700 req-cb971ca6-9e38-47d8-bca7-215f6f0bd352 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428963 Nov 11 12:00:58.928871 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 16de7b1f-2577-472b-b6f9-54cb9aca54c2 details requested by agent hyperv_hv-cinder-81741 with host hv-cinder-81741 {{(pid=88330) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:90}} Nov 11 12:00:59.081424 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:00:59.097188 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Returning: {'device': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'port_id': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'mac_address': 'fa:16:3e:01:5a:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1031, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88330) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 11 12:00:59.173569 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:59.199524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 16de7b1f-2577-472b-b6f9-54cb9aca54c2 {{(pid=88330) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:213}} Nov 11 12:00:59.215444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:00:59.257344 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:00:59.259847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:00:59.331027 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=7']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:00:59.334450 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:00:59.644134 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] get_ports_and_sgs() called for port_ids ['16de7b1f-2577-472b-b6f9-54cb9aca54c2'] {{(pid=88330) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Nov 11 12:01:00.950998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 16de7b1f-2577-472b-b6f9-54cb9aca54c2 up at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Nov 11 12:01:01.031813 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.provisioning_blocks [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Provisioning complete for port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 triggered by entity L2. {{(pid=88330) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Nov 11 12:01:01.032250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned--9223372036853428943'] for port, provisioning_complete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:01.185507 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler--9223372036853606411'] for port, before_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:01.222634 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2'}] {{(pid=88330) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 12:01:01.235278 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:01:01.266093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363305364279122', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363305364688295', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731490087539'] for port, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:01.269870 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-8620eb16-c76b-4e4e-a1f2-c881da8bd23d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:01:01.304196 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'code': 200} Nov 11 12:01:01.351296 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Pushing event updated for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=8']} {{(pid=88330) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:01:01.355541 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=88330) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:01:01.629891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:01:04.894777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:10.015084 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-945c45b4-4406-446c-8413-ce333a04bc1b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:11.261426 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:13.486918 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7b50b773-8190-4168-8e9a-1edbbc76f018 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:13.573073 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:14.795877 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:28.939660 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-638006ca-ccd4-4270-b7e3-910d73a31d1e service neutron] 10.222.0.60 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0754833 Nov 11 12:01:29.092318 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-4046656e-f00c-4e0e-8a37-1af542e97f9b service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.0788147 Nov 11 12:01:29.248860 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-136f21da-cff0-4768-b03d-87812fc6ea0e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:01:29.250497 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-136f21da-cff0-4768-b03d-87812fc6ea0e service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.1384881 Nov 11 12:01:29.356686 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-31efe00e-d011-4fd4-9aca-6317f3d9fd8d service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 1001 time: 0.0995934 Nov 11 12:01:29.425567 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-b38f62ef-1d65-4baf-9444-7bab1eb47147 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:01:29.427179 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-b38f62ef-1d65-4baf-9444-7bab1eb47147 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0636840 Nov 11 12:01:29.509529 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-45765dc0-c4e1-49bb-9092-f66333d4103b service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0753677 Nov 11 12:01:29.653031 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-7b661ada-9e72-4078-bd7c-5b4f3bbfdfc8 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1367552 Nov 11 12:01:29.815751 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6b56758f-cbfc-4789-ac16-0a02c427605f req-bc47359b-3996-498f-a929-db9b9e642e5e service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1559889 Nov 11 12:01:34.911048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:38.629922 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:01:40.011446 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a426baf7-6e28-4650-849d-c1312028620d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:41.254223 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:43.488538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8e6b7299-6b9b-49b2-91c4-1af6f525dc91 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:43.565542 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:01:44.909096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:04.912168 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:10.009759 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-83498f76-9e42-4129-b593-8853c834a057 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:11.261159 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:13.475588 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6235588c-40e5-4908-b69b-39a508f83913 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:13.561253 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:14.804353 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:15.630941 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:02:27.173635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43186) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:27.577381 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Deleting port b294a159-86e1-49f7-ba57-f8f76e3dad73 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:27.577769 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:27.753525 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:27.753904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:27.884724 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Calling delete_port for b294a159-86e1-49f7-ba57-f8f76e3dad73 owned by network:floatingip {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:28.111137 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:28.115729 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-da26bb21-2824-4b0b-8cac-352fd5c93c33 tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:28.159060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event deleted for resources: {'Port': ['ID=b294a159-86e1-49f7-ba57-f8f76e3dad73,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:28.171338 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.171776 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.172197 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.172616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.173236 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.173419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.173826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.174261 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.174617 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.175023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.175453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88328) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:28.418646 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:28.482835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for floatingip, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:28.888722 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 12:02:29.099198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 12:02:29.110363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] Sync routers for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 12:02:29.122521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 12:02:29.123225 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T12:02:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:29.164988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for floatingip, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:29.220564 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2896d3e7-5a5a-4a4e-bca7-e1c54831b278 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "DELETE /v2.0/floatingips/54a1bfa5-29dd-49d1-99fa-12cfa134bb1b HTTP/1.1" status: 204 len: 168 time: 2.0457442 Nov 11 12:02:29.222035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2'}] {{(pid=88328) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 12:02:29.307341 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 12:02:29.400461 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'status': 'completed', 'code': 200} Nov 11 12:02:29.627675 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-1554a0c5-8568-4782-a57e-7e49f7ea983e service neutron] 10.222.0.60 "GET /v2.0/ports?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 1098 time: 0.2048538 Nov 11 12:02:29.770256 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-9d7e20ab-24af-4c94-bbd8-a741dc98bc0d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:02:29.772002 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-9d7e20ab-24af-4c94-bbd8-a741dc98bc0d service neutron] 10.222.0.60 "GET /v2.0/networks?id=5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 200 len: 910 time: 0.1382592 Nov 11 12:02:29.794629 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 5, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:29.798773 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] Checking router: 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 12:02:29.809825 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 12:02:29.810479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T12:02:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:29.841606 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-886d55c8-f96d-42a3-b38a-b269e7fd74e8 service neutron] 10.222.0.60 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 200 len: 217 time: 0.0632234 Nov 11 12:02:29.918524 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-1da3709a-6589-49c7-b6f5-1935755debc5 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:02:29.920133 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-1da3709a-6589-49c7-b6f5-1935755debc5 service neutron] 10.222.0.60 "GET /v2.0/subnets?id=b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 200 len: 847 time: 0.0730593 Nov 11 12:02:30.001306 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-eb956ec9-1261-4ac0-af7d-1519c7b8ee13 service neutron] 10.222.0.60 "GET /v2.0/ports?network_id=5d525e47-392a-4037-a12e-ef51f3af2313&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0749137 Nov 11 12:02:30.005953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 12:02:30.143514 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-8d0bb8ce-8ffe-46f7-b157-a8e58a33916d service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1359558 Nov 11 12:02:30.286974 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-cd0d272f-cd9b-4709-9520-7047faa87707 req-ca418dd3-cf60-4758-b1b6-1c7bc7099169 service neutron] 10.222.0.60 "GET /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1366751 Nov 11 12:02:30.336996 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 5, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:30.341183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebf60547-5a1a-494d-b913-430acb4bd899 None None] The sync data for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi is: [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T11:56:42Z', 'revision_number': 4, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi', '_interfaces': [{'id': 'f2262ce2-cfd5-400f-a206-fd5513909749', 'name': '', 'network_id': '5d525e47-392a-4037-a12e-ef51f3af2313', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'mac_address': 'fa:16:3e:a6:53:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:42Z', 'updated_at': '2021-11-11T11:56:53Z', 'revision_number': 5, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'subnets': [{'id': 'b56fb566-0eb1-4687-8b21-11f7dabfd9bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 12:02:30.766919 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e116bc06-4ef4-4db6-bd60-e67dba89e08e req-355b8c77-2e29-47de-8903-622d9ac16d09 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:02:30.768593 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e116bc06-4ef4-4db6-bd60-e67dba89e08e req-355b8c77-2e29-47de-8903-622d9ac16d09 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0863857 Nov 11 12:02:30.778521 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2da44bd5-d4bf-4377-91df-e6d4cb5b090d None None] New status for floating IP 54a1bfa5-29dd-49d1-99fa-12cfa134bb1b: DOWN {{(pid=88331) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:266}} Nov 11 12:02:30.817911 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-e116bc06-4ef4-4db6-bd60-e67dba89e08e req-10992bfa-ead9-4dee-bbc0-5a9acfedbe88 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431859 Nov 11 12:02:32.034099 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e651761-8b3a-4322-b04a-2939bdbd2187 req-82c9d31a-3dbc-4504-9a47-c35aa2bc7bb8 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:02:32.035709 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e651761-8b3a-4322-b04a-2939bdbd2187 req-82c9d31a-3dbc-4504-9a47-c35aa2bc7bb8 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0808444 Nov 11 12:02:32.087193 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-5e651761-8b3a-4322-b04a-2939bdbd2187 req-112cebe7-e6a4-4744-937d-6cc982c8ffdc tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/security-groups?id=1e86761f-1782-4ce0-a464-16c1324e3cbe&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0453026 Nov 11 12:02:32.350274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-ec482bc6-64f3-4ed8-9fc2-9734a8486436 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88329) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Nov 11 12:02:32.351859 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-ec482bc6-64f3-4ed8-9fc2-9734a8486436 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.60 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 945 time: 0.0840230 Nov 11 12:02:32.425643 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Deleting port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:32.426035 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:32.896425 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] For port 16de7b1f-2577-472b-b6f9-54cb9aca54c2, host hv-cinder-81741, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81741',level=0,port_id=16de7b1f-2577-472b-b6f9-54cb9aca54c2,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:32.896823 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:33.023728 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Calling delete_port for 16de7b1f-2577-472b-b6f9-54cb9aca54c2 owned by compute:nova {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:33.199839 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:33.206407 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2ad230a9-a872-4121-9130-6ba6eeb205f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:33.286060 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event deleted for resources: {'Port': ['ID=16de7b1f-2577-472b-b6f9-54cb9aca54c2,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:33.305655 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-6be0ad43-26f7-4705-a689-b000566279b5 req-ff9e69f3-3fd5-4526-8c2e-3b3742de3cd4 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 210 time: 0.0641432 Nov 11 12:02:33.308656 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.309072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.309479 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.309878 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.310276 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.310814 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.311433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.311433 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.312323 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.312703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.313093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-817417-1-iscsi {{(pid=88329) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Nov 11 12:02:33.341888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:33.385204 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] No DVR routers for this DVR port 16de7b1f-2577-472b-b6f9-54cb9aca54c2 on host hv-cinder-81741 {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 12:02:33.387698 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-719'] for port, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:33.391096 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'name': 'network-vif-deleted', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2'}] {{(pid=88329) send_events /opt/stack/neutron/neutron/notifiers/nova.py:246}} Nov 11 12:02:33.403351 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-8c607be8-e6a8-418f-9e16-f2527f8b3752 req-a8824053-ae57-46b8-b660-84572064aeb2 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.60 "DELETE /v2.0/ports/16de7b1f-2577-472b-b6f9-54cb9aca54c2 HTTP/1.1" status: 204 len: 173 time: 1.0456882 Nov 11 12:02:33.445014 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c25a5b2-fb12-4909-945e-30ce6f6393c4', 'name': 'network-vif-deleted', 'tag': '16de7b1f-2577-472b-b6f9-54cb9aca54c2', 'status': 'completed', 'code': 200} Nov 11 12:02:34.492158 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b16f87b0-6ad7-4d09-8a3b-e5b39fce6e59 req-0dd0e8e5-6328-4cb5-9bf8-f97f4a72a902 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Synchronizing usage tracker for tenant:5d0ef0fa307d43119524263d91d2b2e4 on resource:port {{(pid=88329) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Nov 11 12:02:34.545950 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.quota.resource [req-b16f87b0-6ad7-4d09-8a3b-e5b39fce6e59 req-0dd0e8e5-6328-4cb5-9bf8-f97f4a72a902 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Unset dirty status for tenant:5d0ef0fa307d43119524263d91d2b2e4 on resource:port {{(pid=88329) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Nov 11 12:02:34.547639 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [req-b16f87b0-6ad7-4d09-8a3b-e5b39fce6e59 req-0dd0e8e5-6328-4cb5-9bf8-f97f4a72a902 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "GET /v2.0/ports?device_id=9c25a5b2-fb12-4909-945e-30ce6f6393c4 HTTP/1.1" status: 200 len: 210 time: 0.1024597 Nov 11 12:02:34.911224 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:35.664213 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43220) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:35.746135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d524305-89c9-465c-afd8-0a6cda409ddf tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:35.776286 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d524305-89c9-465c-afd8-0a6cda409ddf tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:36.032106 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d524305-89c9-465c-afd8-0a6cda409ddf tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:36.037780 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-b2d00929-1615-4aac-a0bd-396824b18263 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:36.052783 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d524305-89c9-465c-afd8-0a6cda409ddf tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e86761f-1782-4ce0-a464-16c1324e3cbe,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:36.056023 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6d524305-89c9-465c-afd8-0a6cda409ddf tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:36.058421 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6d524305-89c9-465c-afd8-0a6cda409ddf tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:36.059248 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6d524305-89c9-465c-afd8-0a6cda409ddf tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] 10.222.0.11 "DELETE /v2.0/security-groups/1e86761f-1782-4ce0-a464-16c1324e3cbe HTTP/1.1" status: 204 len: 168 time: 0.3938580 Nov 11 12:02:36.149583 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43226) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:36.739672 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:37.357929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Deleting port f2262ce2-cfd5-400f-a206-fd5513909749 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:37.358241 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:37.513967 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 16de7b1f-2577-472b-b6f9-54cb9aca54c2 no longer exists at agent hyperv_hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 12:02:37.539978 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] For port f2262ce2-cfd5-400f-a206-fd5513909749, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=f2262ce2-cfd5-400f-a206-fd5513909749,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:37.540737 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:37.548495 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] No Port match for: 16de7b1f-2577-472b-b6f9-54cb9aca54c2 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 12:02:37.548894 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Device 16de7b1f-2577-472b-b6f9-54cb9aca54c2 not bound to the agent host hv-cinder-81741 {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 12:02:37.670928 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Calling delete_port for f2262ce2-cfd5-400f-a206-fd5513909749 owned by network:router_interface {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:38.020335 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:38.025243 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-48a6d599-b746-4c73-af17-e10ea6223a1a tempest-TestVolumeBootPattern-1939493118 tempest-TestVolumeBootPattern-1939493118-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:38.068016 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Pushing event deleted for resources: {'Port': ['ID=f2262ce2-cfd5-400f-a206-fd5513909749,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:38.072218 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:38.370048 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:39.187333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 12:02:39.394169 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 12:02:39.403445 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] Sync routers for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 12:02:39.415618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 12:02:39.422274 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T12:02:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:39.445205 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-cc598609-2efb-48f4-acb8-d2746188b94b admin admin] 10.222.0.11 "PUT /v2.0/routers/232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2943091 Nov 11 12:02:39.448110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43236) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:39.612904 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 12:02:39.659183 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks [] for router, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:39.864840 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:39.902865 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Deleting port 97c1209a-045f-401b-8e15-472f1348cee1 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:39.903307 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:39.913609 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '97c1209a-045f-401b-8e15-472f1348cee1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T12:02:37Z', 'revision_number': 5, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port': {'id': '97c1209a-045f-401b-8e15-472f1348cee1', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:c0:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:39Z', 'updated_at': '2021-11-11T11:56:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:39.923968 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] Checking router: 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 for host: dv-cinder-817417-1-iscsi {{(pid=88330) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 12:02:39.935233 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] Routers {'232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88330) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 12:02:39.935907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T12:02:13Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'], 'active': True} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:40.092336 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] For port 97c1209a-045f-401b-8e15-472f1348cee1, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=97c1209a-045f-401b-8e15-472f1348cee1,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:40.092739 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:40.104247 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-12ae7ca8-3388-444e-b016-aae50c0c2d36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:40.109488 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] Set router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 gateway port host: None {{(pid=88330) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 12:02:40.217564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Calling delete_port for 97c1209a-045f-401b-8e15-472f1348cee1 owned by network:router_gateway {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:40.219184 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T12:02:39Z', 'revision_number': 6, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port_host': None}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:40.223453 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-803ca7da-28bf-4fa2-96ff-8eb5466f0807 None None] The sync data for ids ['232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2'] in dv-cinder-817417-1-iscsi is: [{'id': '232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2', 'name': 'tempest-TestShelveInstance-525025880-router', 'tenant_id': '5d0ef0fa307d43119524263d91d2b2e4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:38Z', 'updated_at': '2021-11-11T12:02:39Z', 'revision_number': 6, 'project_id': '5d0ef0fa307d43119524263d91d2b2e4', 'gw_port_host': None}] {{(pid=88330) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 12:02:40.445586 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:40.450685 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6ba69cdf-3b17-4f3d-bce5-ea0933cf5d25 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:40.494143 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Pushing event deleted for resources: {'Port': ['ID=97c1209a-045f-401b-8e15-472f1348cee1,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:40.497210 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:40.733212 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.098948 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f2262ce2-cfd5-400f-a206-fd5513909749 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 12:02:41.135576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: f2262ce2-cfd5-400f-a206-fd5513909749 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 12:02:41.135977 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device f2262ce2-cfd5-400f-a206-fd5513909749 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 12:02:41.136466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 97c1209a-045f-401b-8e15-472f1348cee1 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 12:02:41.173906 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 97c1209a-045f-401b-8e15-472f1348cee1 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 12:02:41.174307 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 97c1209a-045f-401b-8e15-472f1348cee1 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 12:02:41.249141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.254239 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.257333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.374430 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.375630 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 {{(pid=88328) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 12:02:41.388965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.390255 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c9e7f882-7c29-4861-b266-0c937841751a admin admin] 10.222.0.11 "DELETE /v2.0/routers/232b2bf8-f39e-4ddc-9ceb-97ebc27ecff2 HTTP/1.1" status: 204 len: 168 time: 1.9411161 Nov 11 12:02:41.393405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43240) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:41.474473 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] Deleting subnet b56fb566-0eb1-4687-8b21-11f7dabfd9bd {{(pid=88328) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 12:02:41.478277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.532607 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036850920695'] for subnet, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.616366 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.986603 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2678040', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2638849'] for subnet, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:41.991915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:42.028927 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b56fb566-0eb1-4687-8b21-11f7dabfd9bd,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:42.032329 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:42.035107 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] Notify callbacks [] for subnet, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.040914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1197871-35e7-47c1-90fd-f43c2f0f5a34 None None] Network 5d525e47-392a-4037-a12e-ef51f3af2313 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 12:02:42.041862 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-5aa32f22-bb57-4390-a64c-56e473b3bffc admin admin] 10.222.0.11 "DELETE /v2.0/subnets/b56fb566-0eb1-4687-8b21-11f7dabfd9bd HTTP/1.1" status: 204 len: 168 time: 0.6472278 Nov 11 12:02:42.044263 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43244) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:42.166703 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.177616 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Deleting port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:42.177991 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.316422 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] DHCP port deletion for 5d525e47-392a-4037-a12e-ef51f3af2313 request from dv-cinder-817417-1-iscsi {{(pid=88330) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:247}} Nov 11 12:02:42.320657 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] Deleting port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:42.321083 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.394720 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] For port 3bc6a648-9d91-45a5-83cd-b2ce30636a57, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=3bc6a648-9d91-45a5-83cd-b2ce30636a57,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:42.395118 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.533149 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Calling delete_port for 3bc6a648-9d91-45a5-83cd-b2ce30636a57 owned by network:dhcp {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:42.645931 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.650880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-dd28cc27-bb4b-4f7a-aa26-b65027da6bfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:42.693908 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] For port 3bc6a648-9d91-45a5-83cd-b2ce30636a57, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=3bc6a648-9d91-45a5-83cd-b2ce30636a57,segment=NetworkSegment(f9defc44-85fd-41dc-bbc4-4667ef350570),segment_id=f9defc44-85fd-41dc-bbc4-4667ef350570)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:42.694340 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Pushing event deleted for resources: {'Port': ['ID=3bc6a648-9d91-45a5-83cd-b2ce30636a57,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:42.694476 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.697413 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:42.700915 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] No DVR routers for this DVR port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 on host dv-cinder-817417-1-iscsi {{(pid=88328) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 12:02:42.819955 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] Calling delete_port for 3bc6a648-9d91-45a5-83cd-b2ce30636a57 owned by network:dhcp {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:42.825953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.857057 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5d525e47-392a-4037-a12e-ef51f3af2313']}} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:42.870627 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f9defc44-85fd-41dc-bbc4-4667ef350570') {'for_net_delete': True} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:42.870974 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f9defc44-85fd-41dc-bbc4-4667ef350570') {} {{(pid=88328) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:42.883864 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3855104'] for segment, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1917: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding will be deprecated in SQLAlchemy 1.4, and will be disallowed in a future release. viewonly relationships should not be mutated (this warning may be suppressed after 10 occurrences) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: (self, other), Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1917: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags will be deprecated in SQLAlchemy 1.4, and will be disallowed in a future release. viewonly relationships should not be mutated (this warning may be suppressed after 10 occurrences) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: (self, other), Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.887218 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/persistence.py:1364: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 11 12:02:42.890521 dv-cinder-817417-1-iscsi neutron-server[88215]: % (table.description, expected, rows_matched) Nov 11 12:02:42.894482 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 12:02:42.894898 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 12:02:42.957602 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.964405 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Releasing vlan 1031 on physical network physnet1 to pool {{(pid=88328) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 12:02:42.964834 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted--9223372036852097094'] for segment, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 12:02:42.979503 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 12:02:43.095689 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 3bc6a648-9d91-45a5-83cd-b2ce30636a57 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 12:02:43.131570 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 3bc6a648-9d91-45a5-83cd-b2ce30636a57 {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 12:02:43.131965 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 3bc6a648-9d91-45a5-83cd-b2ce30636a57 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 12:02:43.242929 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:43.246474 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:43.260821 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:43.273746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Pushing event deleted for resources: {'Network': ['ID=5d525e47-392a-4037-a12e-ef51f3af2313,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:43.278459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:43.282810 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-f6f38960-c677-4d87-b2cc-f1958212d7ee admin admin] 10.222.0.11 "DELETE /v2.0/networks/5d525e47-392a-4037-a12e-ef51f3af2313 HTTP/1.1" status: 204 len: 168 time: 1.2375028 Nov 11 12:02:43.285880 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43248) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:43.396663 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] Deleting port 3bc6a648-9d91-45a5-83cd-b2ce30636a57 {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:43.397200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:43.464901 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-d03a7194-10fc-41a2-ab5c-4064d83d3753 None None] The port '3bc6a648-9d91-45a5-83cd-b2ce30636a57' was deleted {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1877}} Nov 11 12:02:43.505998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e5d03f74-cfe9-438c-91e2-80d7c6fa226a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:43.580250 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:43.695240 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-4045085'] for router_interface, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:44.320779 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Deleting port cf8e2fcb-c078-437c-bd2e-84f333ba37fc {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:44.321160 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:44.503452 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] For port cf8e2fcb-c078-437c-bd2e-84f333ba37fc, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,segment=NetworkSegment(9a1d0522-cde2-430d-be8b-2969439679f0),segment_id=9a1d0522-cde2-430d-be8b-2969439679f0)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:44.504125 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:44.631520 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Calling delete_port for cf8e2fcb-c078-437c-bd2e-84f333ba37fc owned by network:router_interface {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:44.837502 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:44.912093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:44.916843 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-918e8691-0251-459d-9c5a-f5d8db0885a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:44.962299 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Pushing event deleted for resources: {'Port': ['ID=cf8e2fcb-c078-437c-bd2e-84f333ba37fc,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:44.965087 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:45.266196 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3330877', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-4045191'] for router_interface, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:46.101392 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 has already been hosted by L3 agent 10b068d5-e3b2-48a0-a2a0-6697d0c3bac2 {{(pid=88328) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:131}} Nov 11 12:02:46.313700 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] Notify agent at l3_agent.dv-cinder-817417-1-iscsi the message routers_updated {{(pid=88328) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Nov 11 12:02:46.324283 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] Sync routers for ids ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'] in dv-cinder-817417-1-iscsi {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:121}} Nov 11 12:02:46.337117 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] Routers {'9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 12:02:46.339784 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T12:02:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:46.371269 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-6504fa4d-2260-4d71-a88e-2c344ebb2b10 admin admin] 10.222.0.11 "PUT /v2.0/routers/9b80a1f9-40a3-4e0a-ac7d-58a8179eb176/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0841775 Nov 11 12:02:46.374072 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43254) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:46.520509 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] Set router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 gateway port host: dv-cinder-817417-1-iscsi {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 12:02:46.576655 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks [] for router, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:46.820777 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:46.848230 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'external_fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '7593b896-fda8-486e-851e-df431a45d2fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T12:02:44Z', 'revision_number': 5, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port': {'id': '7593b896-fda8-486e-851e-df431a45d2fe', 'name': '', 'network_id': 'f9bcc1f4-c099-4f1d-8cb0-9bb02d66c5e5', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a7:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-817417-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T11:56:48Z', 'updated_at': '2021-11-11T11:56:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '168d25bd-1d7e-499b-bc86-5ae1423a4145', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-817417-1-iscsi'}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:46.853888 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] Checking router: 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 for host: dv-cinder-817417-1-iscsi {{(pid=88331) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:150}} Nov 11 12:02:46.855208 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Deleting port 7593b896-fda8-486e-851e-df431a45d2fe {{(pid=88328) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:46.855746 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:46.869891 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] Routers {'9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'} bound to L3 agent in host dv-cinder-817417-1-iscsi {{(pid=88331) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Nov 11 12:02:46.870565 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-817417-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T11:31:43Z,description=,heartbeat_timestamp=2021-11-11T12:02:43Z,host='dv-cinder-817417-1-iscsi',id=10b068d5-e3b2-48a0-a2a0-6697d0c3bac2,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T11:31:43Z,topic='l3_agent')) {'router_ids': ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'], 'active': True} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:47.047139 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] For port 7593b896-fda8-486e-851e-df431a45d2fe, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=7593b896-fda8-486e-851e-df431a45d2fe,segment=NetworkSegment(a23adfd8-0d68-4b14-aea4-d4df5cdbf1da),segment_id=a23adfd8-0d68-4b14-aea4-d4df5cdbf1da)] {{(pid=88328) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:47.047576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:47.087135 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvr_db [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] Set router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 gateway port host: None {{(pid=88331) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:873}} Nov 11 12:02:47.187138 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Calling delete_port for 7593b896-fda8-486e-851e-df431a45d2fe owned by network:router_gateway {{(pid=88328) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:47.204289 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_hamode_db [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T12:02:46Z', 'revision_number': 6, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port_host': None}], 'dv-cinder-817417-1-iscsi', False) {} {{(pid=88331) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:47.208573 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaeb3d29-ef02-4719-b17a-9cad689ae77e None None] The sync data for ids ['9b80a1f9-40a3-4e0a-ac7d-58a8179eb176'] in dv-cinder-817417-1-iscsi is: [{'id': '9b80a1f9-40a3-4e0a-ac7d-58a8179eb176', 'name': 'tempest-TestShelveInstance-585402478-router', 'tenant_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T11:56:47Z', 'updated_at': '2021-11-11T12:02:46Z', 'revision_number': 6, 'project_id': 'c129fc4304924d1cbaff9412e4c54ebe', 'gw_port_host': None}] {{(pid=88331) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:134}} Nov 11 12:02:47.555632 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852097682'] for port, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:47.560956 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-4735f79b-4863-4f09-ba9a-46cbed134de1 tempest-AttachVolumeTestJSON-947394916 tempest-AttachVolumeTestJSON-947394916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:47.605054 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Pushing event deleted for resources: {'Port': ['ID=7593b896-fda8-486e-851e-df431a45d2fe,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:47.607797 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:47.844423 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-4039180'] for router_gateway, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.110592 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3894882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider--9223372036854733120'] for router, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.115021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.286157 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3894796'] for router, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.286717 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 {{(pid=88328) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Nov 11 12:02:48.299866 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] Notify callbacks [] for router, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.301121 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-77c09adf-2fdf-4253-adf7-1863e811146b admin admin] 10.222.0.11 "DELETE /v2.0/routers/9b80a1f9-40a3-4e0a-ac7d-58a8179eb176 HTTP/1.1" status: 204 len: 168 time: 1.9259105 Nov 11 12:02:48.303981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 43258) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:48.377545 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.db_base_plugin_v2 [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] Deleting subnet 50f53655-b92a-4474-aa2b-0dbd51fe9929 {{(pid=88329) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1045}} Nov 11 12:02:48.381100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.432723 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852055773'] for subnet, precommit_delete_associations {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.517315 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1358875'] for subnet, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.612466 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853416958', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679977', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852055754', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036852017038'] for subnet, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.617348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:48.654110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=50f53655-b92a-4474-aa2b-0dbd51fe9929,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:48.657003 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:48.660553 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for subnet, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.665909 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffdf09a4-fbc0-4269-a703-057aab08a732 None None] Network 53517e7f-50da-4273-ad84-f2e9aaa53e29 requested from dv-cinder-817417-1-iscsi {{(pid=88330) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Nov 11 12:02:48.667082 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-2711ef21-653d-4294-aca8-ce0b5432acc2 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/50f53655-b92a-4474-aa2b-0dbd51fe9929 HTTP/1.1" status: 204 len: 168 time: 0.3618572 Nov 11 12:02:48.669800 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 43262) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:48.786572 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1202848'] for network, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.798081 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Deleting port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 {{(pid=88329) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:48.798451 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:48.932207 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] DHCP port deletion for 53517e7f-50da-4273-ad84-f2e9aaa53e29 request from dv-cinder-817417-1-iscsi {{(pid=88330) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:247}} Nov 11 12:02:48.936403 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] Deleting port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:48.936826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.019998 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] For port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=36390c35-87ff-46ee-9e5a-1f4c2b065fe5,segment=NetworkSegment(9a1d0522-cde2-430d-be8b-2969439679f0),segment_id=9a1d0522-cde2-430d-be8b-2969439679f0)] {{(pid=88329) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:49.020400 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.124100 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 7593b896-fda8-486e-851e-df431a45d2fe no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 12:02:49.149981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Calling delete_port for 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 owned by network:dhcp {{(pid=88329) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:49.165257 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: 7593b896-fda8-486e-851e-df431a45d2fe {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 12:02:49.165647 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 7593b896-fda8-486e-851e-df431a45d2fe not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 12:02:49.166114 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 12:02:49.220200 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] For port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5, host dv-cinder-817417-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-817417-1-iscsi',level=0,port_id=36390c35-87ff-46ee-9e5a-1f4c2b065fe5,segment=NetworkSegment(9a1d0522-cde2-430d-be8b-2969439679f0),segment_id=9a1d0522-cde2-430d-be8b-2969439679f0)] {{(pid=88330) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:79}} Nov 11 12:02:49.220635 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-4046024'] for port, precommit_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.263765 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change--9223372036853651063', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-56647662', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback--9223363305364279139', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731490087505', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2720064'] for port, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.268739 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a350983e-5c71-4183-9e40-e4cfd297be1e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:49.313731 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Pushing event deleted for resources: {'Port': ['ID=36390c35-87ff-46ee-9e5a-1f4c2b065fe5,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:49.317538 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:49.320795 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] No DVR routers for this DVR port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 on host dv-cinder-817417-1-iscsi {{(pid=88329) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Nov 11 12:02:49.358031 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] Calling delete_port for 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 owned by network:dhcp {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1920}} Nov 11 12:02:49.397203 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.db [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No active binding found for port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 {{(pid=88330) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} Nov 11 12:02:49.397574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 12:02:49.398049 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device cf8e2fcb-c078-437c-bd2e-84f333ba37fc no longer exists at agent ovs-agent-dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Nov 11 12:02:49.434518 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] No Port match for: cf8e2fcb-c078-437c-bd2e-84f333ba37fc {{(pid=88330) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2173}} Nov 11 12:02:49.434907 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.rpc [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Device cf8e2fcb-c078-437c-bd2e-84f333ba37fc not bound to the agent host dv-cinder-817417-1-iscsi {{(pid=88330) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Nov 11 12:02:49.445472 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1355650', 'neutron.services.segments.db._delete_segments_for_network-8731490625736'] for network, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.466181 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.db.api [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88330) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Nov 11 12:02:49.466590 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_db.api [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88330) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Nov 11 12:02:49.473855 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['53517e7f-50da-4273-ad84-f2e9aaa53e29']}} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:49.486890 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a1d0522-cde2-430d-be8b-2969439679f0') {'for_net_delete': True} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:49.487404 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.services.segments.db [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a1d0522-cde2-430d-be8b-2969439679f0') {} {{(pid=88329) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Nov 11 12:02:49.501302 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731490634969', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2720042'] for segment, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.516936 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853418780'] for segment, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.524294 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Releasing vlan 1007 on physical network physnet1 to pool {{(pid=88329) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:326}} Nov 11 12:02:49.524730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1357053', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2720660'] for segment, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: Traceback (most recent call last): Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: timer() Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: cb(*args, **kw) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: return func(*args, **kwargs) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: self._notify() Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: self.callback(batched_events) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: event.method(event) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: segment_id)['aggregates'][0] Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 56, in wrapper Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: return f(self, *a, **k) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: return self._get(url).json() Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: **kwargs) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1123, in get Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: return self.request(url, 'GET', **kwargs) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 794, in request Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: **endpoint_filter) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1223, in get_endpoint Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1163, in _auth_required Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 12:02:49.539623 dv-cinder-817417-1-iscsi neutron-server[88215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 12:02:49.666618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853420151', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850679991', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036851444939', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036850736414'] for network, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.670333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-44c5c465-e0b3-4194-93f0-4fcbdb2cfe28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:49.684395 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036851444798'] for network, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:49.695847 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Pushing event deleted for resources: {'Network': ['ID=53517e7f-50da-4273-ad84-f2e9aaa53e29,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:49.701086 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:49.704364 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-c17b1b5f-fde2-4834-abf5-ec8f4950fa05 admin admin] 10.222.0.11 "DELETE /v2.0/networks/53517e7f-50da-4273-ad84-f2e9aaa53e29 HTTP/1.1" status: 204 len: 168 time: 1.0334992 Nov 11 12:02:49.906732 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 43268) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:49.960492 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a1b02856-c85b-431d-a621-e4768726b879 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5d0ef0fa307d43119524263d91d2b2e4&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0523875 Nov 11 12:02:49.963164 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88329) accepted ('10.222.0.11', 43272) {{(pid=88329) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:49.968343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] Deleting port 36390c35-87ff-46ee-9e5a-1f4c2b065fe5 {{(pid=88330) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1847}} Nov 11 12:02:49.968789 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363305364282825'] for port, before_delete {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:50.028331 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3604a17-8953-4e76-8b45-8037c5e940c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:50.033798 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.plugins.ml2.plugin [None req-96be6e52-8c8e-41f1-b26e-5479781f2d0f None None] The port '36390c35-87ff-46ee-9e5a-1f4c2b065fe5' was deleted {{(pid=88330) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1877}} Nov 11 12:02:50.057144 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3604a17-8953-4e76-8b45-8037c5e940c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:50.206298 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3604a17-8953-4e76-8b45-8037c5e940c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:50.211484 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d6c353e1-0936-4023-81e7-be924099311a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:50.223636 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3604a17-8953-4e76-8b45-8037c5e940c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ac74602-8ac2-4e50-a2b4-57fbd015296b,revision_number=None']} {{(pid=88329) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:50.226706 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-a3604a17-8953-4e76-8b45-8037c5e940c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=88329) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:50.228674 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a3604a17-8953-4e76-8b45-8037c5e940c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88329) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:50.229893 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-a3604a17-8953-4e76-8b45-8037c5e940c5 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/5ac74602-8ac2-4e50-a2b4-57fbd015296b HTTP/1.1" status: 204 len: 168 time: 0.2657483 Nov 11 12:02:50.945363 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43280) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:50.999102 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-b2634493-edfb-45c7-a21c-fbb02f3481ba admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c129fc4304924d1cbaff9412e4c54ebe&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0524061 Nov 11 12:02:51.001741 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [-] (88328) accepted ('10.222.0.11', 43284) {{(pid=88328) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Nov 11 12:02:51.074006 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d69a8a99-1058-445c-8b9d-939b5d0b073b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:51.101618 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d69a8a99-1058-445c-8b9d-939b5d0b073b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:51.223462 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d69a8a99-1058-445c-8b9d-939b5d0b073b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036850741349'] for security_group, after_delete {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:51.228835 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-f9ce0175-6dce-4f78-b535-247d422a59d5 tempest-TestShelveInstance-436816203 tempest-TestShelveInstance-436816203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Nov 11 12:02:51.245576 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69a8a99-1058-445c-8b9d-939b5d0b073b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bff7fd11-dda7-4536-be07-75cb430ad6b9,revision_number=None']} {{(pid=88328) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Nov 11 12:02:51.248658 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG oslo_concurrency.lockutils [None req-d69a8a99-1058-445c-8b9d-939b5d0b073b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=88328) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Nov 11 12:02:51.249575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-d69a8a99-1058-445c-8b9d-939b5d0b073b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88328) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:02:51.250793 dv-cinder-817417-1-iscsi neutron-server[88215]: INFO neutron.wsgi [None req-d69a8a99-1058-445c-8b9d-939b5d0b073b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/bff7fd11-dda7-4536-be07-75cb430ad6b9 HTTP/1.1" status: 204 len: 168 time: 0.2479563 Nov 11 12:02:52.632110 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:03:04.909730 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:10.022141 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-46f2511c-e380-4937-9165-bbbce77a35b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:11.253348 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:13.475981 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-14f49978-5a1b-4fad-bba7-22ed82a96c28 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:13.576517 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:14.807322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:29.632093 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:03:34.928343 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:40.024496 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-e6b760d6-cbf4-4a28-af37-43021225c2c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:41.252970 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:43.500461 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-61008857-ac59-4c7e-986f-deecc1e52cf6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:43.574562 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:03:44.908551 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:04.933277 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:06.633021 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:04:10.015988 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-176412a8-1811-4505-8cbb-e7f8036df754 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:11.244512 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:13.482419 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-ef43ba8a-fc41-4255-b215-4c5f0d07b936 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:13.579940 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:14.816032 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:34.935442 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:40.011659 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-aa758e71-c44d-42dd-9d96-254b9cab3dbf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:41.246938 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:43.483786 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-f459dffb-b2a5-4808-8f89-a0004e9ead62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:43.592575 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:04:43.633369 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:04:44.815267 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:04.932841 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:10.001444 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-9b8388ff-bdad-44f5-90ce-2bedc2db380c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:11.252802 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:13.481574 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-a19e479a-dc1c-4807-8ff1-91799ee7ba8b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:13.584791 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:14.819523 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:20.633480 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:05:34.945487 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:40.008812 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7aab14ef-cbc5-4b07-ac7b-faf7a98407f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:41.266826 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:43.482820 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-14f0d3d4-3798-42c6-9a83-85b52a71a6c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:43.585954 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:44.920162 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:05:57.635322 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:06:04.941459 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:10.031458 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5e37a77c-0f35-4706-929a-840dda2b5bdf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:11.261608 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:13.479017 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-50b8ef82-bb54-4623-9a77-17f7a11e19c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:13.581529 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:14.820098 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:34.636470 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:06:34.953679 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:40.011333 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-48165fe7-b417-4677-be00-48a8a4e1591c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:41.263102 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:43.492115 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-376ed5ee-cfde-490c-9971-7c2dc56714cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:43.593436 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:06:44.821614 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:04.965147 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:09.995294 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-5b0c4b99-36c5-4976-9b13-8cab17f13731 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:11.258745 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:11.636872 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:07:13.485953 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-6c96d31e-4b37-4d34-b1c8-892fe61db3f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:13.595768 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:14.829939 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:34.955245 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:40.007949 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-056f6020-c50c-42c1-9124-7ec756328ee9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:41.288346 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:43.488435 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-8be86543-962e-41c4-9737-3344f44b6e79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:43.601889 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:45.099676 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:07:48.638914 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}} Nov 11 12:08:02.717752 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-61a1cfc3-9495-4c6b-a3cc-4d88e903199b req-6034f143-9148-4a38-91cd-6566af411fed service neutron] (88329) timed out ('10.222.0.60', 64955) {{(pid=88329) process_request /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:830}} Nov 11 12:08:04.963281 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-41d61aa4-a9de-43a1-927e-90a63a7e07da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:08:10.009762 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-bc626ea2-e735-4227-a94e-fb86635aea6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:08:11.261564 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-c449c4c3-32cf-4af3-895b-aea895d4e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:08:11.438396 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.wsgi [req-91ba6ce4-73a5-4dc2-9b02-81c9f53442d7 req-f91aa68b-b92a-4e9f-83fe-3d3c8cd740de service neutron] (88328) timed out ('10.222.0.60', 64961) {{(pid=88328) process_request /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:830}} Nov 11 12:08:13.488872 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-85311bff-be07-4113-8189-b7bf5770fb1b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:08:13.604127 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-15c8b66b-4d53-4118-aff7-ee1d7533a926 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:08:14.838198 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron_lib.callbacks.manager [None req-7c193529-a5ce-4d76-8e62-7cd8ee5abd43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731490625719', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1346917'] for agent, after_update {{(pid=88330) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 11 12:08:25.640271 dv-cinder-817417-1-iscsi neutron-server[88215]: DEBUG neutron.db.agents_db [None req-5572b388-340b-4d39-bf7b-197cee0d04c0 None None] Agent healthcheck: found 6 active agents {{(pid=88331) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:330}}